__   __
  /  \ /  \     ______   _    _     __   __   __
 / /\ / /\ \   /  __  \ | |  | |   /  \  \ \ / /
/ /  / /  \ \  | |  | | | |  | |  / /\ \  \   /
\ \  \ \  / /  | |__| | | |__| | / ____ \  | |
 \ \/ \ \/ /   \_  ___/  \____/ /_/    \_\ |_|
  \__/ \__/      \ \__
                  \___\ by Red Hat
 Build, Store, and Distribute your Containers

Startup timestamp: 
Mon Apr 22 03:33:14 UTC 2024

Running all default registry services without migration
Running init script '/quay-registry/conf/init/certs_install.sh'
Installing extra certificates found in /quay-registry/conf/stack/extra_ca_certs directory
Running init script '/quay-registry/conf/init/client_certs.sh'
Running init script '/quay-registry/conf/init/copy_config_files.sh'
Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh'
Validating Configuration
time="2024-04-22T03:33:15Z" level=debug msg="Validating AccessSettings"
time="2024-04-22T03:33:15Z" level=debug msg="Validating ActionLogArchiving"
time="2024-04-22T03:33:15Z" level=debug msg="Validating AppTokenAuthentication"
time="2024-04-22T03:33:15Z" level=debug msg="Validating BitbucketBuildTrigger"
time="2024-04-22T03:33:15Z" level=debug msg="Validating BuildManager"
time="2024-04-22T03:33:15Z" level=debug msg="Validating Database"
time="2024-04-22T03:33:15Z" level=debug msg="Scheme: postgresql"
time="2024-04-22T03:33:15Z" level=debug msg="Host: quayregistry-quay-database:5432"
time="2024-04-22T03:33:15Z" level=debug msg="Db: quayregistry-quay-database"
time="2024-04-22T03:33:15Z" level=debug msg="Params: "
time="2024-04-22T03:33:15Z" level=debug msg="Including params "
time="2024-04-22T03:33:15Z" level=debug msg="Pinging database at postgresql://quayregistry-quay-database:LR26GYE2Q6C1alDmIITINfDYIVNBINfu7Ep3m38KlTCvZwaP6XwkLo53vn3GRqC-4WmofCbZLtxhHtn8@quayregistry-quay-database:5432/quayregistry-quay-database"
plpgsql
pg_trgm
time="2024-04-22T03:33:15Z" level=debug msg="Validating DistributedStorage"
time="2024-04-22T03:33:15Z" level=debug msg="Validating ElasticSearch"
time="2024-04-22T03:33:15Z" level=debug msg="Validating Email"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GitHubBuildTrigger"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GitHubLogin"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GitLabBuildTrigger"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GoogleLogin"
time="2024-04-22T03:33:16Z" level=debug msg="Validating HostSettings"
time="2024-04-22T03:33:16Z" level=debug msg="Validating JWTAuthentication"
time="2024-04-22T03:33:16Z" level=debug msg="Validating LDAP"
time="2024-04-22T03:33:16Z" level=debug msg="Validating OIDC"
time="2024-04-22T03:33:16Z" level=debug msg="Validating QuayDocumentation"
time="2024-04-22T03:33:16Z" level=debug msg="Validating Redis"
time="2024-04-22T03:33:16Z" level=debug msg="Address: quayregistry-quay-redis:6379"
time="2024-04-22T03:33:16Z" level=debug msg="Username: "
time="2024-04-22T03:33:16Z" level=debug msg="Password Len: 0"
time="2024-04-22T03:33:16Z" level=debug msg="Ssl: <nil>"
time="2024-04-22T03:33:16Z" level=debug msg="Address: quayregistry-quay-redis:6379"
time="2024-04-22T03:33:16Z" level=debug msg="Username: "
time="2024-04-22T03:33:16Z" level=debug msg="Password Len: 0"
time="2024-04-22T03:33:16Z" level=debug msg="Ssl: <nil>"
time="2024-04-22T03:33:16Z" level=debug msg="Validating RepoMirror"
time="2024-04-22T03:33:16Z" level=debug msg="Validating SecurityScanner"
time="2024-04-22T03:33:16Z" level=debug msg="Validating TeamSyncing"
time="2024-04-22T03:33:16Z" level=debug msg="Validating TimeMachine"
time="2024-04-22T03:33:16Z" level=debug msg="Validating UserVisibleSettings"
+------------------------+-------+--------+
|      Field Group       | Error | Status |
+------------------------+-------+--------+
| AccessSettings         | -     | 🟢     |
+------------------------+-------+--------+
| ActionLogArchiving     | -     | 🟢     |
+------------------------+-------+--------+
| AppTokenAuthentication | -     | 🟢     |
+------------------------+-------+--------+
| BitbucketBuildTrigger  | -     | 🟢     |
+------------------------+-------+--------+
| BuildManager           | -     | 🟢     |
+------------------------+-------+--------+
| Database               | -     | 🟢     |
+------------------------+-------+--------+
| DistributedStorage     | -     | 🟢     |
+------------------------+-------+--------+
| ElasticSearch          | -     | 🟢     |
+------------------------+-------+--------+
| Email                  | -     | 🟢     |
+------------------------+-------+--------+
| GitHubBuildTrigger     | -     | 🟢     |
+------------------------+-------+--------+
| GitHubLogin            | -     | 🟢     |
+------------------------+-------+--------+
| GitLabBuildTrigger     | -     | 🟢     |
+------------------------+-------+--------+
| GoogleLogin            | -     | 🟢     |
+------------------------+-------+--------+
| HostSettings           | -     | 🟢     |
+------------------------+-------+--------+
| JWTAuthentication      | -     | 🟢     |
+------------------------+-------+--------+
| LDAP                   | -     | 🟢     |
+------------------------+-------+--------+
| OIDC                   | -     | 🟢     |
+------------------------+-------+--------+
| QuayDocumentation      | -     | 🟢     |
+------------------------+-------+--------+
| Redis                  | -     | 🟢     |
+------------------------+-------+--------+
| RepoMirror             | -     | 🟢     |
+------------------------+-------+--------+
| SecurityScanner        | -     | 🟢     |
+------------------------+-------+--------+
| TeamSyncing            | -     | 🟢     |
+------------------------+-------+--------+
| TimeMachine            | -     | 🟢     |
+------------------------+-------+--------+
| UserVisibleSettings    | -     | 🟢     |
+------------------------+-------+--------+
Running init script '/quay-registry/conf/init/nginx_conf_create.sh'
Running init script '/quay-registry/conf/init/supervisord_conf_create.sh'
Running init script '/quay-registry/conf/init/zz_boot.sh'
/app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if word_sep is not '':
2024-04-22 03:33:19,861 INFO RPC interface 'supervisor' initialized
2024-04-22 03:33:19,861 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2024-04-22 03:33:19,861 INFO supervisord started with pid 7
2024-04-22 03:33:20,863 INFO spawned: 'stdout' with pid 59
2024-04-22 03:33:20,865 INFO spawned: 'autopruneworker' with pid 60
2024-04-22 03:33:20,866 INFO spawned: 'blobuploadcleanupworker' with pid 61
2024-04-22 03:33:20,868 INFO spawned: 'builder' with pid 62
2024-04-22 03:33:20,870 INFO spawned: 'buildlogsarchiver' with pid 63
2024-04-22 03:33:20,871 INFO spawned: 'chunkcleanupworker' with pid 64
2024-04-22 03:33:20,873 INFO spawned: 'dnsmasq' with pid 65
2024-04-22 03:33:20,874 INFO spawned: 'expiredappspecifictokenworker' with pid 66
2024-04-22 03:33:20,877 INFO spawned: 'exportactionlogsworker' with pid 67
2024-04-22 03:33:20,879 INFO spawned: 'gcworker' with pid 68
2024-04-22 03:33:20,881 INFO spawned: 'globalpromstats' with pid 69
2024-04-22 03:33:20,883 INFO spawned: 'gunicorn-registry' with pid 70
2024-04-22 03:33:20,885 INFO spawned: 'gunicorn-secscan' with pid 71
2024-04-22 03:33:20,951 INFO spawned: 'gunicorn-web' with pid 72
2024-04-22 03:33:20,953 INFO spawned: 'logrotateworker' with pid 73
2024-04-22 03:33:20,955 INFO spawned: 'manifestbackfillworker' with pid 74
2024-04-22 03:33:20,957 INFO spawned: 'memcache' with pid 75
2024-04-22 03:33:20,960 INFO spawned: 'namespacegcworker' with pid 76
2024-04-22 03:33:20,962 INFO spawned: 'nginx' with pid 77
2024-04-22 03:33:20,964 INFO spawned: 'notificationworker' with pid 78
2024-04-22 03:33:20,967 INFO spawned: 'pushgateway' with pid 79
2024-04-22 03:33:20,968 INFO spawned: 'queuecleanupworker' with pid 80
2024-04-22 03:33:21,051 INFO spawned: 'quotaregistrysizeworker' with pid 81
2024-04-22 03:33:21,053 INFO spawned: 'quotatotalworker' with pid 83
2024-04-22 03:33:21,055 INFO spawned: 'reconciliationworker' with pid 88
2024-04-22 03:33:21,058 INFO spawned: 'repositoryactioncounter' with pid 89
2024-04-22 03:33:21,060 INFO spawned: 'repositorygcworker' with pid 90
2024-04-22 03:33:21,062 INFO spawned: 'securityscanningnotificationworker' with pid 91
2024-04-22 03:33:21,152 INFO spawned: 'securityworker' with pid 92
2024-04-22 03:33:21,154 INFO spawned: 'servicekey' with pid 93
2024-04-22 03:33:21,156 INFO spawned: 'storagereplication' with pid 94
2024-04-22 03:33:21,159 INFO spawned: 'teamsyncworker' with pid 98
2024-04-22 03:33:22,652 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: autopruneworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: manifestbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: quotaregistrysizeworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: quotatotalworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: reconciliationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: securityscanningnotificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
dnsmasq stderr | dnsmasq: started, version 2.79 cachesize 150
dnsmasq stderr | dnsmasq: compile time options: IPv6 GNU-getopt DBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth DNSSEC loop-detect inotify
dnsmasq stderr | dnsmasq: reading /etc/resolv.conf
dnsmasq stderr | dnsmasq: using nameserver 172.30.0.10#53
dnsmasq stderr | dnsmasq: read /etc/hosts - 7 addresses
nginx stdout | 2024/04/22 03:33:21 [alert] 103#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 106#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 107#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 109#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 115#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 100#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 112#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 111#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 108#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 114#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 101#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 102#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 99#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 116#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 110#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 113#0: setpriority(-10) failed (13: Permission denied)
pushgateway stderr | ts=2024-04-22T03:33:21.359Z caller=main.go:86 level=info msg="starting pushgateway" version="(version=, branch=, revision=unknown)"
pushgateway stderr | ts=2024-04-22T03:33:21.360Z caller=main.go:87 level=info build_context="(go=go1.19.13, platform=linux/amd64, user=, date=, tags=unknown)"
pushgateway stderr | ts=2024-04-22T03:33:21.651Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9091
pushgateway stderr | ts=2024-04-22T03:33:21.651Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9091
nginx stdout | 2024/04/22 03:33:30 [crit] 103#0: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.131.0.31:8080"
nginx stdout | 2024/04/22 03:33:30 [crit] 103#0: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.131.0.31:8080"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:33:30 +0000] "GET /health/instance HTTP/1.1" 502 157 "-" "kube-probe/1.28" (0.000 118 0.000 : 0.000)
expiredappspecifictokenworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
expiredappspecifictokenworker stderr |   if word_sep is not '':
securityscanningnotificationworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
securityscanningnotificationworker stderr |   if word_sep is not '':
nginx stdout | 2024/04/22 03:33:45 [crit] 106#0: *4 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.131.0.31:8080"
nginx stdout | 2024/04/22 03:33:45 [crit] 106#0: *4 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.131.0.31:8080"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:33:45 +0000] "GET /health/instance HTTP/1.1" 502 157 "-" "kube-probe/1.28" (0.000 118 0.000 : 0.000)
repositorygcworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
repositorygcworker stderr |   if word_sep is not '':
quotatotalworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
quotatotalworker stderr |   if word_sep is not '':
chunkcleanupworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
chunkcleanupworker stderr |   if word_sep is not '':
builder stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
builder stderr |   if word_sep is not '':
repositoryactioncounter stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
repositoryactioncounter stderr |   if word_sep is not '':
quotaregistrysizeworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
quotaregistrysizeworker stderr |   if word_sep is not '':
gunicorn-web stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gunicorn-web stderr |   if word_sep is not '':
teamsyncworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
teamsyncworker stderr |   if word_sep is not '':
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,553 [66] [DEBUG] [__main__] Starting expired app specific token GC worker
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,554 [66] [DEBUG] [__main__] Found expiration window: 1d
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,557 [66] [DEBUG] [workers.worker] Scheduling worker.
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,559 [66] [INFO] [apscheduler.scheduler] Scheduler started
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,755 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,757 [66] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,761 [66] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:57:16.762836
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,856 [66] [INFO] [apscheduler.scheduler] Added job "ExpiredAppSpecificTokenWorker._gc_expired_tokens" to job store "default"
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,856 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,856 [66] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:16.762836+00:00 (in 1402.906307 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,354 [91] [DEBUG] [__main__] Starting security scanning notification worker
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,357 [91] [DEBUG] [workers.worker] Scheduling worker.
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,358 [91] [INFO] [apscheduler.scheduler] Scheduler started
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,551 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,551 [91] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:16.552337
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,552 [91] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,554 [91] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,554 [91] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:37:21.555879
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:02.556208
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:02.556208+00:00 (in 8.000475 seconds)
buildlogsarchiver stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
buildlogsarchiver stderr |   if word_sep is not '':
globalpromstats stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
globalpromstats stderr |   if word_sep is not '':
notificationworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
notificationworker stderr |   if word_sep is not '':
gcworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gcworker stderr |   if word_sep is not '':
logrotateworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
logrotateworker stderr |   if word_sep is not '':
autopruneworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
autopruneworker stderr |   if word_sep is not '':
exportactionlogsworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
exportactionlogsworker stderr |   if word_sep is not '':
gunicorn-secscan stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gunicorn-secscan stderr |   if word_sep is not '':
builder stdout | 2024-04-22 03:33:56,760 [62] [DEBUG] [__main__] Building is disabled. Please enable the feature flag
repositoryactioncounter stdout | 2024-04-22 03:33:56,957 [89] [DEBUG] [workers.worker] Scheduling worker.
repositoryactioncounter stdout | 2024-04-22 03:33:56,958 [89] [INFO] [apscheduler.scheduler] Scheduler started
repositoryactioncounter stdout | 2024-04-22 03:33:57,060 [89] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositoryactioncounter stdout | 2024-04-22 03:33:57,060 [89] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:49:55.061170
repositoryactioncounter stdout | 2024-04-22 03:33:57,152 [89] [INFO] [apscheduler.scheduler] Added job "RepositoryActionCountWorker._run_counting" to job store "default"
repositoryactioncounter stdout | 2024-04-22 03:33:57,060 [89] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
repositoryactioncounter stdout | 2024-04-22 03:33:57,153 [89] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositoryactioncounter stdout | 2024-04-22 03:33:57,153 [89] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:55.061170+00:00 (in 957.907498 seconds)
servicekey stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
servicekey stderr |   if word_sep is not '':
gunicorn-web stdout | 2024-04-22 03:33:59,453 [72] [DEBUG] [app] Loading default config.
gunicorn-web stdout | 2024-04-22 03:33:59,455 [72] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml
gunicorn-web stdout | 2024-04-22 03:33:59,555 [72] [DEBUG] [app] Loaded config
gunicorn-web stdout | 2024-04-22 03:33:59,558 [72] [INFO] [util.ipresolver] Loading AWS IP ranges from disk
gunicorn-web stdout | 2024-04-22 03:33:59,656 [72] [DEBUG] [util.ipresolver] Building AWS IP ranges
blobuploadcleanupworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
blobuploadcleanupworker stderr |   if word_sep is not '':
chunkcleanupworker stdout | 2024-04-22 03:34:00,563 [64] [DEBUG] [__main__] Swift storage not detected; sleeping
nginx stdout | 2024/04/22 03:34:00 [crit] 107#0: *7 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.131.0.31:8080"
nginx stdout | 2024/04/22 03:34:00 [crit] 107#0: *7 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.131.0.31:8080"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:00 +0000] "GET /health/instance HTTP/1.1" 502 157 "-" "kube-probe/1.28" (0.000 118 0.000 : 0.000)
gunicorn-web stdout | 2024-04-22 03:34:00,661 [72] [DEBUG] [util.ipresolver] Finished building AWS IP ranges
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,357 [81] [DEBUG] [workers.worker] Scheduling worker.
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,359 [81] [INFO] [apscheduler.scheduler] Scheduler started
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,360 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,360 [81] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:24.361582
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,363 [81] [INFO] [apscheduler.scheduler] Added job "QuotaRegistrySizeWorker._calculate_registry_size" to job store "default"
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,361 [81] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,451 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,451 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:24.361582+00:00 (in 22.910429 seconds)
repositorygcworker stdout | 2024-04-22 03:34:01,451 [90] [DEBUG] [__main__] Starting repository GC worker
repositorygcworker stdout | 2024-04-22 03:34:01,453 [90] [DEBUG] [workers.worker] Scheduling worker.
repositorygcworker stdout | 2024-04-22 03:34:01,454 [90] [INFO] [apscheduler.scheduler] Scheduler started
repositorygcworker stdout | 2024-04-22 03:34:01,551 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:01,551 [90] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:06.552482
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:36:51.555445
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:13.555667
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
repositorygcworker stdout | 2024-04-22 03:34:01,552 [90] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
repositorygcworker stdout | 2024-04-22 03:34:01,560 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:01,561 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:06.552482+00:00 (in 4.991028 seconds)
queuecleanupworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
queuecleanupworker stderr |   if word_sep is not '':
securityworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
securityworker stderr |   if word_sep is not '':
gunicorn-web stdout | 2024-04-22 03:34:02,051 [72] [DEBUG] [data.database] Configuring database
gunicorn-web stdout | 2024-04-22 03:34:02,054 [72] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:02,055 [72] [INFO] [data.secscan_model] ===============================
gunicorn-web stdout | 2024-04-22 03:34:02,056 [72] [INFO] [data.secscan_model] Using split secscan model: `[<data.secscan_model.secscan_v4_model.V4SecurityScanner object at 0x7f90a284a730>]`
gunicorn-web stdout | 2024-04-22 03:34:02,057 [72] [INFO] [data.secscan_model] ===============================
gunicorn-web stdout | 2024-04-22 03:34:02,058 [72] [DEBUG] [data.logs_model] Configuring log model
gunicorn-web stdout | 2024-04-22 03:34:02,058 [72] [INFO] [data.logs_model] ===============================
gunicorn-web stdout | 2024-04-22 03:34:02,059 [72] [INFO] [data.logs_model] Using logs model `<data.logs_model.table_logs_model.TableLogsModel object at 0x7f90a284a970>`
gunicorn-web stdout | 2024-04-22 03:34:02,060 [72] [INFO] [data.logs_model] ===============================
teamsyncworker stdout | 2024-04-22 03:34:02,160 [98] [DEBUG] [__main__] Team syncing is disabled; sleeping
namespacegcworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
namespacegcworker stderr |   if word_sep is not '':
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,751 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:02 UTC)" (scheduled at 2024-04-22 03:34:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,751 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:16.552337+00:00 (in 13.800838 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,752 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,754 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:02 UTC)" executed successfully
manifestbackfillworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
manifestbackfillworker stderr |   if word_sep is not '':
reconciliationworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
reconciliationworker stderr |   if word_sep is not '':
gunicorn-secscan stdout | 2024-04-22 03:34:04,052 [71] [DEBUG] [app] Loading default config.
gunicorn-secscan stdout | 2024-04-22 03:34:04,054 [71] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml
gunicorn-secscan stdout | 2024-04-22 03:34:04,152 [71] [DEBUG] [app] Loaded config
gunicorn-secscan stdout | 2024-04-22 03:34:04,154 [71] [INFO] [util.ipresolver] Loading AWS IP ranges from disk
gunicorn-secscan stdout | 2024-04-22 03:34:04,255 [71] [DEBUG] [util.ipresolver] Building AWS IP ranges
buildlogsarchiver stdout | 2024-04-22 03:34:04,853 [63] [DEBUG] [workers.worker] Scheduling worker.
buildlogsarchiver stdout | 2024-04-22 03:34:04,855 [63] [INFO] [apscheduler.scheduler] Scheduler started
buildlogsarchiver stdout | 2024-04-22 03:34:05,051 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:05,051 [63] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:17.052354
buildlogsarchiver stdout | 2024-04-22 03:34:05,052 [63] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
buildlogsarchiver stdout | 2024-04-22 03:34:05,055 [63] [INFO] [apscheduler.scheduler] Added job "ArchiveBuildLogsWorker._archive_redis_buildlogs" to job store "default"
buildlogsarchiver stdout | 2024-04-22 03:34:05,055 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:05,055 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:17.052354+00:00 (in 11.996536 seconds)
gunicorn-secscan stdout | 2024-04-22 03:34:05,262 [71] [DEBUG] [util.ipresolver] Finished building AWS IP ranges
storagereplication stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
storagereplication stderr |   if word_sep is not '':
notificationworker stdout | 2024-04-22 03:34:05,755 [78] [DEBUG] [workers.worker] Scheduling worker.
notificationworker stdout | 2024-04-22 03:34:05,757 [78] [INFO] [apscheduler.scheduler] Scheduler started
notificationworker stdout | 2024-04-22 03:34:05,758 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:05,758 [78] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:13.759375
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:38:19.762160
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:19.762424
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
notificationworker stdout | 2024-04-22 03:34:05,759 [78] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
notificationworker stdout | 2024-04-22 03:34:05,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:05,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:13.759375+00:00 (in 7.996510 seconds)
gcworker stdout | 2024-04-22 03:34:05,856 [68] [DEBUG] [workers.worker] Scheduling worker.
gcworker stdout | 2024-04-22 03:34:05,856 [68] [INFO] [apscheduler.scheduler] Scheduler started
gunicorn-secscan stdout | 2024-04-22 03:34:05,862 [71] [DEBUG] [data.database] Configuring database
gunicorn-secscan stdout | 2024-04-22 03:34:05,863 [71] [INFO] [data.database] Connection pooling disabled for postgresql
gcworker stdout | 2024-04-22 03:34:05,865 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:05,866 [68] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
gcworker stdout | 2024-04-22 03:34:05,951 [68] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:14.952062
gunicorn-secscan stdout | 2024-04-22 03:34:05,951 [71] [INFO] [data.secscan_model] ===============================
gunicorn-secscan stdout | 2024-04-22 03:34:05,951 [71] [INFO] [data.secscan_model] Using split secscan model: `[<data.secscan_model.secscan_v4_model.V4SecurityScanner object at 0x7f75f962e4f0>]`
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.secscan_model] ===============================
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [DEBUG] [data.logs_model] Configuring log model
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.logs_model] ===============================
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.logs_model] Using logs model `<data.logs_model.table_logs_model.TableLogsModel object at 0x7f75f962e700>`
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.logs_model] ===============================
gcworker stdout | 2024-04-22 03:34:05,953 [68] [INFO] [apscheduler.scheduler] Added job "GarbageCollectionWorker._garbage_collection_repos" to job store "default"
gcworker stdout | 2024-04-22 03:34:05,953 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:05,953 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:14.952062+00:00 (in 8.998490 seconds)
repositorygcworker stdout | 2024-04-22 03:34:06,553 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:06,554 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:06 UTC)" (scheduled at 2024-04-22 03:34:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:34:06,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:13.555667+00:00 (in 7.000568 seconds)
repositorygcworker stdout | 2024-04-22 03:34:06,555 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:34:06,559 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 6, 557538), True, datetime.datetime(2024, 4, 22, 3, 34, 6, 557538), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:34:06,572 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:34:06,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:34:06,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:34:06,963 [93] [DEBUG] [workers.worker] Scheduling worker.
servicekey stdout | 2024-04-22 03:34:07,051 [93] [INFO] [apscheduler.scheduler] Scheduler started
logrotateworker stdout | 2024-04-22 03:34:07,052 [73] [DEBUG] [__main__] Action log rotation worker not enabled; skipping
servicekey stdout | 2024-04-22 03:34:07,052 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 03:34:07,052 [93] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:38:04.053182
servicekey stdout | 2024-04-22 03:34:07,052 [93] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
servicekey stdout | 2024-04-22 03:34:07,054 [93] [INFO] [apscheduler.scheduler] Added job "ServiceKeyWorker._refresh_service_key" to job store "default"
servicekey stdout | 2024-04-22 03:34:07,054 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 03:34:07,054 [93] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:04.053182+00:00 (in 236.998508 seconds)
globalpromstats stdout | 2024-04-22 03:34:07,257 [69] [DEBUG] [workers.worker] Scheduling worker.
globalpromstats stdout | 2024-04-22 03:34:07,257 [69] [INFO] [apscheduler.scheduler] Scheduler started
globalpromstats stdout | 2024-04-22 03:34:07,259 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
globalpromstats stdout | 2024-04-22 03:34:07,259 [69] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
globalpromstats stdout | 2024-04-22 03:34:07,259 [69] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:54:08.260282
globalpromstats stdout | 2024-04-22 03:34:07,261 [69] [INFO] [apscheduler.scheduler] Added job "GlobalPrometheusStatsWorker._try_report_stats" to job store "default"
globalpromstats stdout | 2024-04-22 03:34:07,261 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
globalpromstats stdout | 2024-04-22 03:34:07,261 [69] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:08.260282+00:00 (in 1200.998698 seconds)
autopruneworker stdout | 2024-04-22 03:34:07,262 [60] [DEBUG] [workers.worker] Scheduling worker.
autopruneworker stdout | 2024-04-22 03:34:07,262 [60] [INFO] [apscheduler.scheduler] Scheduler started
autopruneworker stdout | 2024-04-22 03:34:07,263 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:07,263 [60] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
autopruneworker stdout | 2024-04-22 03:34:07,263 [60] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:11.264267
autopruneworker stdout | 2024-04-22 03:34:07,264 [60] [INFO] [apscheduler.scheduler] Added job "AutoPruneWorker.prune" to job store "default"
autopruneworker stdout | 2024-04-22 03:34:07,359 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:07,360 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:11.264267+00:00 (in 3.904216 seconds)
gunicorn-secscan stdout | 2024-04-22 03:34:07,662 [71] [DEBUG] [__config__] Starting secscan gunicorn with 2 workers and gevent worker class
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,966 [61] [DEBUG] [workers.worker] Scheduling worker.
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [INFO] [apscheduler.scheduler] Scheduler started
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 04:11:42.968897
blobuploadcleanupworker stdout | 2024-04-22 03:34:08,051 [61] [INFO] [apscheduler.scheduler] Added job "BlobUploadCleanupWorker._try_cleanup_uploads" to job store "default"
blobuploadcleanupworker stdout | 2024-04-22 03:34:08,051 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
blobuploadcleanupworker stdout | 2024-04-22 03:34:08,051 [61] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:42.968897+00:00 (in 2254.917522 seconds)
queuecleanupworker stdout | 2024-04-22 03:34:08,765 [80] [DEBUG] [workers.worker] Scheduling worker.
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [INFO] [apscheduler.scheduler] Scheduler started
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 14:53:32.767890
queuecleanupworker stdout | 2024-04-22 03:34:08,768 [80] [INFO] [apscheduler.scheduler] Added job "QueueCleanupWorker._cleanup_queue" to job store "default"
queuecleanupworker stdout | 2024-04-22 03:34:08,768 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
queuecleanupworker stdout | 2024-04-22 03:34:08,769 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 14:53:32.767890+00:00 (in 40763.998785 seconds)
namespacegcworker stdout | 2024-04-22 03:34:09,053 [76] [DEBUG] [__main__] Starting namespace GC worker
namespacegcworker stdout | 2024-04-22 03:34:09,054 [76] [DEBUG] [workers.worker] Scheduling worker.
namespacegcworker stdout | 2024-04-22 03:34:09,055 [76] [INFO] [apscheduler.scheduler] Scheduler started
namespacegcworker stdout | 2024-04-22 03:34:09,056 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:09,056 [76] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
namespacegcworker stdout | 2024-04-22 03:34:09,056 [76] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:43.057186
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:37:38.058708
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:22.058978
namespacegcworker stdout | 2024-04-22 03:34:09,058 [76] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
namespacegcworker stdout | 2024-04-22 03:34:09,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:09,058 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:22.058978+00:00 (in 13.000658 seconds)
manifestbackfillworker stdout | 2024-04-22 03:34:09,068 [74] [DEBUG] [workers.worker] Scheduling worker.
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [INFO] [apscheduler.scheduler] Scheduler started
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 04:26:47.070659
manifestbackfillworker stdout | 2024-04-22 03:34:09,071 [74] [INFO] [apscheduler.scheduler] Added job "ManifestBackfillWorker._backfill_manifests" to job store "default"
manifestbackfillworker stdout | 2024-04-22 03:34:09,071 [74] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
manifestbackfillworker stdout | 2024-04-22 03:34:09,071 [74] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:47.070659+00:00 (in 3157.999322 seconds)
exportactionlogsworker stdout | 2024-04-22 03:34:09,561 [67] [DEBUG] [__main__] Starting export action logs worker
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [workers.worker] Scheduling worker.
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [INFO] [apscheduler.scheduler] Scheduler started
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:41.564959
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:36:53.566665
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:39.566970
exportactionlogsworker stdout | 2024-04-22 03:34:09,566 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
exportactionlogsworker stdout | 2024-04-22 03:34:09,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:09,566 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:39.566970+00:00 (in 30.000589 seconds)
storagereplication stdout | 2024-04-22 03:34:09,660 [94] [DEBUG] [__main__] Full storage replication disabled; skipping
gunicorn-web stdout | 2024-04-22 03:34:09,764 [72] [DEBUG] [__config__] Starting web gunicorn with 4 workers and gevent worker class
gunicorn-registry stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gunicorn-registry stderr |   if word_sep is not '':
securityworker stdout | 2024-04-22 03:34:09,869 [92] [DEBUG] [workers.worker] Scheduling worker.
securityworker stdout | 2024-04-22 03:34:09,870 [92] [INFO] [apscheduler.scheduler] Scheduler started
securityworker stdout | 2024-04-22 03:34:09,870 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:09,870 [92] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
securityworker stdout | 2024-04-22 03:34:09,870 [92] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:35.871852
securityworker stdout | 2024-04-22 03:34:09,872 [92] [INFO] [apscheduler.scheduler] Added job "SecurityWorker._index_in_scanner" to job store "default"
securityworker stdout | 2024-04-22 03:34:09,872 [92] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:26.873109
securityworker stdout | 2024-04-22 03:34:09,872 [92] [INFO] [apscheduler.scheduler] Added job "SecurityWorker._index_recent_manifests_in_scanner" to job store "default"
securityworker stdout | 2024-04-22 03:34:09,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:09,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:26.873109+00:00 (in 17.000703 seconds)
gunicorn-registry stdout | 2024-04-22 03:34:10,265 [70] [DEBUG] [app] Loading default config.
gunicorn-registry stdout | 2024-04-22 03:34:10,265 [70] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml
gunicorn-registry stdout | 2024-04-22 03:34:10,273 [70] [DEBUG] [app] Loaded config
gunicorn-registry stdout | 2024-04-22 03:34:10,274 [70] [INFO] [util.ipresolver] Loading AWS IP ranges from disk
gunicorn-registry stdout | 2024-04-22 03:34:10,281 [70] [DEBUG] [util.ipresolver] Building AWS IP ranges
gunicorn-registry stdout | 2024-04-22 03:34:10,363 [70] [DEBUG] [util.ipresolver] Finished building AWS IP ranges
gunicorn-registry stdout | 2024-04-22 03:34:10,467 [70] [DEBUG] [data.database] Configuring database
gunicorn-registry stdout | 2024-04-22 03:34:10,468 [70] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.secscan_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.secscan_model] Using split secscan model: `[<data.secscan_model.secscan_v4_model.V4SecurityScanner object at 0x7fd05e41ba00>]`
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.secscan_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [DEBUG] [data.logs_model] Configuring log model
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.logs_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.logs_model] Using logs model `<data.logs_model.table_logs_model.TableLogsModel object at 0x7fd05e41bd30>`
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.logs_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:11,139 [70] [DEBUG] [__config__] Starting registry gunicorn with 8 workers and gevent worker class
autopruneworker stdout | 2024-04-22 03:34:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:11 UTC)" (scheduled at 2024-04-22 03:34:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:34:11,265 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:41.264267+00:00 (in 29.998704 seconds)
autopruneworker stdout | 2024-04-22 03:34:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756791272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:34:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:34:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:34:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:34:13,556 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:06.552482+00:00 (in 52.995574 seconds)
repositorygcworker stdout | 2024-04-22 03:34:13,557 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:13 UTC)" (scheduled at 2024-04-22 03:34:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:34:13,557 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:34:13,557 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:34:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:13 UTC)" (scheduled at 2024-04-22 03:34:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 13, 760327), True, datetime.datetime(2024, 4, 22, 3, 34, 13, 760327), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:13,761 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:19.762424+00:00 (in 6.000459 seconds)
notificationworker stdout | 2024-04-22 03:34:13,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:13,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:34:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:14 UTC)" (scheduled at 2024-04-22 03:34:14.952062+00:00)
gcworker stdout | 2024-04-22 03:34:14,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 03:34:14,953 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:44.952062+00:00 (in 29.998242 seconds)
gcworker stdout | 2024-04-22 03:34:14,963 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:34:14,963 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:34:14,963 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:34:15,656 [281] [DEBUG] [app] Starting request: urn:request:a1ab9b43-e4b5-4a15-ae5a-10f747bab705 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:15,661 [281] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-registry stdout | 2024-04-22 03:34:15,678 [290] [DEBUG] [app] Starting request: urn:request:d888993e-e714-430b-a879-a438dc4720ad (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:15,679 [290] [DEBUG] [app] Ending request: urn:request:d888993e-e714-430b-a879-a438dc4720ad (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d888993e-e714-430b-a879-a438dc4720ad', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.005 162 0.005)
gunicorn-registry stdout | 2024-04-22 03:34:15,680 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,680 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,682 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:15,683 [281] [DEBUG] [app] Starting request: urn:request:9f4ef8dc-4980-4152-b297-35f3fe094670 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:15,684 [281] [DEBUG] [app] Ending request: urn:request:9f4ef8dc-4980-4152-b297-35f3fe094670 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9f4ef8dc-4980-4152-b297-35f3fe094670', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:15,685 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,685 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,688 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 15, 686768), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 15, 686831), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 15, 686847), datetime.datetime(2024, 4, 15, 3, 34, 15, 686857), None])
gunicorn-web stdout | 2024-04-22 03:34:15,700 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:15,706 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:15,708 [281] [DEBUG] [app] Ending request: urn:request:a1ab9b43-e4b5-4a15-ae5a-10f747bab705 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1ab9b43-e4b5-4a15-ae5a-10f747bab705', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:15,708 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:15,708 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.056 118 0.056)
gunicorn-web stdout | 2024-04-22 03:34:15,710 [281] [DEBUG] [app] Starting request: urn:request:3d018141-7292-449b-ad92-c52d7abb4b95 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-registry stdout | 2024-04-22 03:34:15,712 [290] [DEBUG] [app] Starting request: urn:request:b3fd0506-3fae-4b42-b7f3-4d74d2a90859 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:15,712 [290] [DEBUG] [app] Ending request: urn:request:b3fd0506-3fae-4b42-b7f3-4d74d2a90859 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b3fd0506-3fae-4b42-b7f3-4d74d2a90859', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:34:15,713 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,713 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,714 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:15,719 [278] [DEBUG] [app] Starting request: urn:request:55a0a886-14cc-474a-b461-c1694d1a23f6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:15,719 [278] [DEBUG] [app] Ending request: urn:request:55a0a886-14cc-474a-b461-c1694d1a23f6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:55a0a886-14cc-474a-b461-c1694d1a23f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.005 159 0.005)
gunicorn-web stdout | 2024-04-22 03:34:15,720 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,720 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,721 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:15,728 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:15,737 [281] [DEBUG] [app] Ending request: urn:request:3d018141-7292-449b-ad92-c52d7abb4b95 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3d018141-7292-449b-ad92-c52d7abb4b95', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:15,737 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:15,737 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,553 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:02.556208+00:00 (in 46.002292 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,554 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:16 UTC)" (scheduled at 2024-04-22 03:34:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,554 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,555 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 16, 554179), True, datetime.datetime(2024, 4, 22, 3, 34, 16, 554179), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,566 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,566 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,566 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:34:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:17 UTC)" (scheduled at 2024-04-22 03:34:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:34:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 34, 17, 53317), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:34:17,054 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:47.052354+00:00 (in 29.997837 seconds)
buildlogsarchiver stdout | 2024-04-22 03:34:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:34:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:34:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:34:18,285 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:34:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:23.759375+00:00 (in 3.996445 seconds)
notificationworker stdout | 2024-04-22 03:34:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:19 UTC)" (scheduled at 2024-04-22 03:34:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:34:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:34:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:34:19,985 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:34:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:22 UTC)" (scheduled at 2024-04-22 03:34:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:34:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:34:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:22 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:34:22,060 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:43.057186+00:00 (in 20.996856 seconds)
builder stdout | 2024-04-22 03:34:23,495 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:34:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:33.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 03:34:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:33 UTC)" (scheduled at 2024-04-22 03:34:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 23, 760335), True, datetime.datetime(2024, 4, 22, 3, 34, 23, 760335), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:24 UTC)" (scheduled at 2024-04-22 03:34:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,363 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:24.361582+00:00 (in 59.998168 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,373 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,373 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:34:25,085 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:34:26,457 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:34:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:26 UTC)" (scheduled at 2024-04-22 03:34:26.873109+00:00)
securityworker stdout | 2024-04-22 03:34:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:34:26,874 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:35.871852+00:00 (in 8.997267 seconds)
securityworker stdout | 2024-04-22 03:34:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:34:26,936 [92] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): quayregistry-clair-app.quay-enterprise.svc.cluster.local:80
securityworker stdout | 2024-04-22 03:34:26,948 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:34:26,950 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:26,960 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:34:26,962 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:26,962 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:26,963 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 29, 26, 950180), 1, 2])
securityworker stdout | 2024-04-22 03:34:26,965 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:26,965 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:26,965 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 29, 26, 950180), 1, 2])
securityworker stdout | 2024-04-22 03:34:26,968 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:26,968 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:26,969 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,969 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:34:26,969 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:34:28,485 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:34:28,487 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:34:29,564 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:34:29,577 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:34:29,578 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:34:29,580 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:34:29,581 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:34:29,582 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:34:30,656 [282] [DEBUG] [app] Starting request: urn:request:8a8064ed-64e5-4b78-a6e7-7cc50740291d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:30,658 [279] [DEBUG] [app] Starting request: urn:request:93d8624f-5c59-4ed3-9295-0441128eeb23 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:30,663 [282] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-web stdout | 2024-04-22 03:34:30,664 [279] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-registry stdout | 2024-04-22 03:34:30,665 [290] [DEBUG] [app] Starting request: urn:request:1da8c45c-ca32-4b77-aaaa-810734ada300 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:30,666 [290] [DEBUG] [app] Ending request: urn:request:1da8c45c-ca32-4b77-aaaa-810734ada300 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1da8c45c-ca32-4b77-aaaa-810734ada300', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:34:30,666 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:34:30,666 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:30,668 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:34:30,668 [292] [DEBUG] [app] Starting request: urn:request:6eb5df7b-6fe4-4d7d-a687-32ff98f4446f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:30,669 [282] [DEBUG] [app] Starting request: urn:request:3f364d4a-6403-4fad-b222-55b88895481e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:30,670 [292] [DEBUG] [app] Ending request: urn:request:6eb5df7b-6fe4-4d7d-a687-32ff98f4446f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6eb5df7b-6fe4-4d7d-a687-32ff98f4446f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:34:30,670 [282] [DEBUG] [app] Ending request: urn:request:3f364d4a-6403-4fad-b222-55b88895481e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3f364d4a-6403-4fad-b222-55b88895481e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.005 162 0.004)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-registry stdout | 2024-04-22 03:34:30,670 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:30,670 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:30,670 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:30,671 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:30,672 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:30,674 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 30, 672342), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 30, 672375), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 30, 672394), datetime.datetime(2024, 4, 15, 3, 34, 30, 672407), None])
gunicorn-web stdout | 2024-04-22 03:34:30,674 [278] [DEBUG] [app] Starting request: urn:request:e2fca224-ada3-4029-b259-acf07265594f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:30,675 [278] [DEBUG] [app] Ending request: urn:request:e2fca224-ada3-4029-b259-acf07265594f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2fca224-ada3-4029-b259-acf07265594f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:34:30,675 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:30,675 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:30,678 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 30, 676640), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 30, 676681), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 30, 676698), datetime.datetime(2024, 4, 15, 3, 34, 30, 676712), None])
gunicorn-web stdout | 2024-04-22 03:34:30,685 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:30,689 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:30,691 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:30,694 [282] [DEBUG] [app] Ending request: urn:request:8a8064ed-64e5-4b78-a6e7-7cc50740291d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8a8064ed-64e5-4b78-a6e7-7cc50740291d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:30,694 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:30,695 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:30,695 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.043 118 0.043)
gunicorn-web stdout | 2024-04-22 03:34:30,697 [279] [DEBUG] [app] Ending request: urn:request:93d8624f-5c59-4ed3-9295-0441128eeb23 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:93d8624f-5c59-4ed3-9295-0441128eeb23', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:30,698 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.046 118 0.046)
gunicorn-web stdout | 2024-04-22 03:34:30,698 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:34:30,984 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:34:32,393 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:34:32,667 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:34:32,679 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:34:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:43.759375+00:00 (in 9.999515 seconds)
notificationworker stdout | 2024-04-22 03:34:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:43 UTC)" (scheduled at 2024-04-22 03:34:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 33, 760233), True, datetime.datetime(2024, 4, 22, 3, 34, 33, 760233), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:34:33,787 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:34:34,175 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:34:34,177 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:34:34,178 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:34:34,972 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:34:35,088 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:34:35,297 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:56.873109+00:00 (in 21.000775 seconds)
securityworker stdout | 2024-04-22 03:34:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:05 UTC)" (scheduled at 2024-04-22 03:34:35.871852+00:00)
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:34:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:34:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:34:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:34:36,088 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:34:37,485 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:34:37,604 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:34:38,000 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:34:38,178 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:34:39,207 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:39 UTC)" (scheduled at 2024-04-22 03:34:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:39 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:34:39,568 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:41.564959+00:00 (in 1.996676 seconds)
gunicorn-registry stdout | 2024-04-22 03:34:40,353 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:34:40,356 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:34:40,359 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:34:40,361 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:34:40,365 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:34:40,367 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:34:40,370 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:34:40,372 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:34:40,374 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:34:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:11.264267+00:00 (in 29.999455 seconds)
autopruneworker stdout | 2024-04-22 03:34:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:11 UTC)" (scheduled at 2024-04-22 03:34:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:34:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756821271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:34:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:34:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:34:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:39.566970+00:00 (in 58.001538 seconds)
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:41 UTC)" (scheduled at 2024-04-22 03:34:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:34:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 41, 565701), True, datetime.datetime(2024, 4, 22, 3, 34, 41, 565701), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:34:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:34:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:34:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:34:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:22.058978+00:00 (in 39.001314 seconds)
namespacegcworker stdout | 2024-04-22 03:34:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:43 UTC)" (scheduled at 2024-04-22 03:34:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:34:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:34:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 43, 58042), True, datetime.datetime(2024, 4, 22, 3, 34, 43, 58042), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:34:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:34:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:34:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:34:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:53.759375+00:00 (in 9.999532 seconds)
notificationworker stdout | 2024-04-22 03:34:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:53 UTC)" (scheduled at 2024-04-22 03:34:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 43, 760214), True, datetime.datetime(2024, 4, 22, 3, 34, 43, 760214), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:34:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:14.952062+00:00 (in 29.999526 seconds)
gcworker stdout | 2024-04-22 03:34:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:14 UTC)" (scheduled at 2024-04-22 03:34:44.952062+00:00)
gcworker stdout | 2024-04-22 03:34:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:34:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:34:45,653 [278] [DEBUG] [app] Starting request: urn:request:3f08bbe6-dd7d-43c4-89f6-6e00c044e38c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:45,653 [281] [DEBUG] [app] Starting request: urn:request:33f40d34-0162-46e3-ba10-ef9fb20c8ee2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:45,658 [278] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-registry stdout | 2024-04-22 03:34:45,659 [288] [DEBUG] [app] Starting request: urn:request:6b663a2e-f47c-4127-a981-5211108a84c8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:45,660 [288] [DEBUG] [app] Ending request: urn:request:6b663a2e-f47c-4127-a981-5211108a84c8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6b663a2e-f47c-4127-a981-5211108a84c8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.003)
gunicorn-registry stdout | 2024-04-22 03:34:45,660 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:34:45,661 [291] [DEBUG] [app] Starting request: urn:request:8bfd7aac-ab06-40f6-9a69-f0f8b14d35c1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:45,662 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:34:45,662 [291] [DEBUG] [app] Ending request: urn:request:8bfd7aac-ab06-40f6-9a69-f0f8b14d35c1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8bfd7aac-ab06-40f6-9a69-f0f8b14d35c1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.004 162 0.004)
gunicorn-registry stdout | 2024-04-22 03:34:45,663 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:45,663 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:45,663 [282] [DEBUG] [app] Starting request: urn:request:ef02fdad-9492-4fcf-a820-79a53546e2ff (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:45,664 [282] [DEBUG] [app] Ending request: urn:request:ef02fdad-9492-4fcf-a820-79a53546e2ff (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ef02fdad-9492-4fcf-a820-79a53546e2ff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:34:45,664 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:45,664 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:45,664 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:45,665 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:45,666 [279] [DEBUG] [app] Starting request: urn:request:355b2c36-0d5b-4c64-9f7a-8de2c1b7032e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:45,666 [279] [DEBUG] [app] Ending request: urn:request:355b2c36-0d5b-4c64-9f7a-8de2c1b7032e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:355b2c36-0d5b-4c64-9f7a-8de2c1b7032e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:45,667 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:45,667 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:45,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 45, 668369), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 45, 668395), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 45, 668408), datetime.datetime(2024, 4, 15, 3, 34, 45, 668417), None])
gunicorn-web stdout | 2024-04-22 03:34:45,671 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:45,678 [281] [DEBUG] [app] Ending request: urn:request:33f40d34-0162-46e3-ba10-ef9fb20c8ee2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:33f40d34-0162-46e3-ba10-ef9fb20c8ee2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:45,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:45,679 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
gunicorn-web stdout | 2024-04-22 03:34:45,680 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:45,686 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:45,688 [278] [DEBUG] [app] Ending request: urn:request:3f08bbe6-dd7d-43c4-89f6-6e00c044e38c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3f08bbe6-dd7d-43c4-89f6-6e00c044e38c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:45,689 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.037 118 0.037)
gunicorn-web stdout | 2024-04-22 03:34:45,689 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:34:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:47,053 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:17.052354+00:00 (in 29.999367 seconds)
buildlogsarchiver stdout | 2024-04-22 03:34:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:17 UTC)" (scheduled at 2024-04-22 03:34:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:34:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 34, 47, 53405), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:34:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:34:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:34:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:34:48,322 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:34:50,021 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:34:53,524 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:34:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:03.759375+00:00 (in 9.999485 seconds)
notificationworker stdout | 2024-04-22 03:34:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:03 UTC)" (scheduled at 2024-04-22 03:34:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 53, 760184), True, datetime.datetime(2024, 4, 22, 3, 34, 53, 760184), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:34:55,117 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:34:56,489 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:05.871852+00:00 (in 8.998280 seconds)
securityworker stdout | 2024-04-22 03:34:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:26 UTC)" (scheduled at 2024-04-22 03:34:56.873109+00:00)
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:34:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:34:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:34:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:34:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 29, 56, 881790), 1, 2])
securityworker stdout | 2024-04-22 03:34:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:56,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 29, 56, 881790), 1, 2])
securityworker stdout | 2024-04-22 03:34:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:34:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:34:56,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:34:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:34:56,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:34:58,492 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:34:58,522 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:34:59,572 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:34:59,585 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:34:59,588 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:34:59,591 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:34:59,593 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:34:59,612 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:35:00,653 [278] [DEBUG] [app] Starting request: urn:request:2f11131e-7c65-4b39-a0da-5886a3f31bfb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:00,653 [281] [DEBUG] [app] Starting request: urn:request:5bb2ab15-685f-402c-8530-c1760d520a80 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:00,658 [284] [DEBUG] [app] Starting request: urn:request:beeef3a7-fc71-49c8-84e2-d9a76ee3105b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:00,658 [289] [DEBUG] [app] Starting request: urn:request:033676f1-39fa-4c20-9650-cf1fe398cb41 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:00,659 [284] [DEBUG] [app] Ending request: urn:request:beeef3a7-fc71-49c8-84e2-d9a76ee3105b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:beeef3a7-fc71-49c8-84e2-d9a76ee3105b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:00,659 [289] [DEBUG] [app] Ending request: urn:request:033676f1-39fa-4c20-9650-cf1fe398cb41 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:033676f1-39fa-4c20-9650-cf1fe398cb41', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.004)
gunicorn-registry stdout | 2024-04-22 03:35:00,660 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:35:00,660 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.004 162 0.004)
gunicorn-web stdout | 2024-04-22 03:35:00,661 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:00,662 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:00,663 [282] [DEBUG] [app] Starting request: urn:request:a4cf03e0-9679-4fc7-888f-8cf0cbccd005 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:00,663 [282] [DEBUG] [app] Ending request: urn:request:a4cf03e0-9679-4fc7-888f-8cf0cbccd005 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a4cf03e0-9679-4fc7-888f-8cf0cbccd005', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:00,663 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:00,663 [279] [DEBUG] [app] Starting request: urn:request:5ba2e4a1-8ee1-4765-b3a4-8174a87ccd48 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:00,663 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:00,664 [279] [DEBUG] [app] Ending request: urn:request:5ba2e4a1-8ee1-4765-b3a4-8174a87ccd48 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5ba2e4a1-8ee1-4765-b3a4-8174a87ccd48', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:00,664 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:00,664 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:00,664 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:00,664 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:00,670 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:00,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:00,678 [278] [DEBUG] [app] Ending request: urn:request:2f11131e-7c65-4b39-a0da-5886a3f31bfb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f11131e-7c65-4b39-a0da-5886a3f31bfb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:00,678 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:00,678 [281] [DEBUG] [app] Ending request: urn:request:5bb2ab15-685f-402c-8530-c1760d520a80 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5bb2ab15-685f-402c-8530-c1760d520a80', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:00,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:35:00,678 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:35:00,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:35:01,010 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:35:02,405 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:16.552337+00:00 (in 13.995669 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:02 UTC)" (scheduled at 2024-04-22 03:35:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:35:02,677 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:35:02,696 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:35:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 03:35:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:13 UTC)" (scheduled at 2024-04-22 03:35:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 3, 760233), True, datetime.datetime(2024, 4, 22, 3, 35, 3, 760233), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:35:03,821 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:35:04,183 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:35:04,186 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:35:04,188 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:35:04,978 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:35:05,125 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:35:05,334 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:35:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:26.873109+00:00 (in 21.000742 seconds)
securityworker stdout | 2024-04-22 03:35:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:35 UTC)" (scheduled at 2024-04-22 03:35:05.871852+00:00)
securityworker stdout | 2024-04-22 03:35:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:35:06,124 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:35:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:35:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:13.555667+00:00 (in 7.002692 seconds)
repositorygcworker stdout | 2024-04-22 03:35:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:06 UTC)" (scheduled at 2024-04-22 03:35:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:35:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:35:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 6, 553411), True, datetime.datetime(2024, 4, 22, 3, 35, 6, 553411), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:35:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:35:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:35:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:35:07,522 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:35:07,619 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:35:08,037 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:35:08,189 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:35:09,225 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:35:10,364 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:35:10,369 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:35:10,371 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:35:10,374 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:35:10,376 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:35:10,380 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:35:10,382 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:35:10,385 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:35:10,387 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:35:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:35:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:41.264267+00:00 (in 29.999493 seconds)
autopruneworker stdout | 2024-04-22 03:35:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:41 UTC)" (scheduled at 2024-04-22 03:35:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:35:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756851271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:35:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:35:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:35:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:35:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:06.552482+00:00 (in 52.996344 seconds)
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:13 UTC)" (scheduled at 2024-04-22 03:35:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:35:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:19.762424+00:00 (in 6.002589 seconds)
notificationworker stdout | 2024-04-22 03:35:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:23 UTC)" (scheduled at 2024-04-22 03:35:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 13, 760209), True, datetime.datetime(2024, 4, 22, 3, 35, 13, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:35:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:35:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:44.952062+00:00 (in 29.999567 seconds)
gcworker stdout | 2024-04-22 03:35:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:44 UTC)" (scheduled at 2024-04-22 03:35:14.952062+00:00)
gcworker stdout | 2024-04-22 03:35:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:35:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:35:15,653 [282] [DEBUG] [app] Starting request: urn:request:fa7a3e18-bfe2-4269-9e95-b909d8d78bec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:15,653 [278] [DEBUG] [app] Starting request: urn:request:367f5d7f-66e2-4db5-aa90-40cce5d45bd5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:15,656 [290] [DEBUG] [app] Starting request: urn:request:f8fa58cd-4665-4989-95b4-5514baf6f31e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [284] [DEBUG] [app] Starting request: urn:request:9c532159-adf3-4ec4-9e21-a50b803c483f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [290] [DEBUG] [app] Ending request: urn:request:f8fa58cd-4665-4989-95b4-5514baf6f31e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f8fa58cd-4665-4989-95b4-5514baf6f31e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [284] [DEBUG] [app] Ending request: urn:request:9c532159-adf3-4ec4-9e21-a50b803c483f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9c532159-adf3-4ec4-9e21-a50b803c483f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:15,660 [278] [DEBUG] [app] Starting request: urn:request:5eb61f6e-73ee-4a17-bb91-8519bf9376b5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:15,660 [278] [DEBUG] [app] Ending request: urn:request:5eb61f6e-73ee-4a17-bb91-8519bf9376b5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5eb61f6e-73ee-4a17-bb91-8519bf9376b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:15,660 [281] [DEBUG] [app] Starting request: urn:request:42a8c2f9-4632-4cf4-8a43-f7713c963966 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:15,661 [281] [DEBUG] [app] Ending request: urn:request:42a8c2f9-4632-4cf4-8a43-f7713c963966 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:42a8c2f9-4632-4cf4-8a43-f7713c963966', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:15,675 [278] [DEBUG] [app] Ending request: urn:request:367f5d7f-66e2-4db5-aa90-40cce5d45bd5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:367f5d7f-66e2-4db5-aa90-40cce5d45bd5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:15,675 [282] [DEBUG] [app] Ending request: urn:request:fa7a3e18-bfe2-4269-9e95-b909d8d78bec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fa7a3e18-bfe2-4269-9e95-b909d8d78bec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:35:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:02.556208+00:00 (in 46.003344 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:16 UTC)" (scheduled at 2024-04-22 03:35:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,553 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 16, 553183), True, datetime.datetime(2024, 4, 22, 3, 35, 16, 553183), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:35:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:35:17,053 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:47.052354+00:00 (in 29.999209 seconds)
buildlogsarchiver stdout | 2024-04-22 03:35:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:47 UTC)" (scheduled at 2024-04-22 03:35:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:35:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 35, 17, 53547), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:35:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:35:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:35:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:35:18,358 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:35:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:23.759375+00:00 (in 3.996491 seconds)
notificationworker stdout | 2024-04-22 03:35:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:19 UTC)" (scheduled at 2024-04-22 03:35:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:35:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:35:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:35:20,058 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:43.057186+00:00 (in 20.997736 seconds)
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:22 UTC)" (scheduled at 2024-04-22 03:35:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:35:23,560 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:35:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:33.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 03:35:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:33 UTC)" (scheduled at 2024-04-22 03:35:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 23, 760373), True, datetime.datetime(2024, 4, 22, 3, 35, 23, 760373), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:23,773 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:23,773 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:24.361582+00:00 (in 59.999499 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:24 UTC)" (scheduled at 2024-04-22 03:35:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:35:25,132 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:35:26,526 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:35.871852+00:00 (in 8.998287 seconds)
securityworker stdout | 2024-04-22 03:35:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:56 UTC)" (scheduled at 2024-04-22 03:35:26.873109+00:00)
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:35:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:35:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:35:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 30, 26, 881612), 1, 2])
securityworker stdout | 2024-04-22 03:35:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 30, 26, 881612), 1, 2])
securityworker stdout | 2024-04-22 03:35:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:35:28,527 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:35:28,559 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:35:29,580 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:35:29,592 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:35:29,595 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:35:29,599 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:35:29,602 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:35:29,641 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:35:30,653 [278] [DEBUG] [app] Starting request: urn:request:442f7523-d5d7-431c-9106-932633a50d01 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:30,653 [281] [DEBUG] [app] Starting request: urn:request:d06c3a45-31a6-48df-aa59-f60175f87ce4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:30,656 [284] [DEBUG] [app] Starting request: urn:request:85b27047-6976-4e8d-b7d0-010541018316 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:30,656 [292] [DEBUG] [app] Starting request: urn:request:05e9dba9-7ad3-4943-ad36-f2cd275d25fd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [284] [DEBUG] [app] Ending request: urn:request:85b27047-6976-4e8d-b7d0-010541018316 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:85b27047-6976-4e8d-b7d0-010541018316', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [292] [DEBUG] [app] Ending request: urn:request:05e9dba9-7ad3-4943-ad36-f2cd275d25fd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05e9dba9-7ad3-4943-ad36-f2cd275d25fd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:30,660 [278] [DEBUG] [app] Starting request: urn:request:aa99a7f1-39e3-4094-8a7f-90f8b4e9374b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:30,660 [278] [DEBUG] [app] Ending request: urn:request:aa99a7f1-39e3-4094-8a7f-90f8b4e9374b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:aa99a7f1-39e3-4094-8a7f-90f8b4e9374b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:30,660 [279] [DEBUG] [app] Starting request: urn:request:c000f626-af0b-46a1-bebc-5f16ab7788d2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,661 [279] [DEBUG] [app] Ending request: urn:request:c000f626-af0b-46a1-bebc-5f16ab7788d2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c000f626-af0b-46a1-bebc-5f16ab7788d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:30,675 [278] [DEBUG] [app] Ending request: urn:request:442f7523-d5d7-431c-9106-932633a50d01 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:442f7523-d5d7-431c-9106-932633a50d01', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:30,675 [281] [DEBUG] [app] Ending request: urn:request:d06c3a45-31a6-48df-aa59-f60175f87ce4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d06c3a45-31a6-48df-aa59-f60175f87ce4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:35:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:35:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
notificationworker stdout | 2024-04-22 03:35:31,017 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:35:32,412 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:35:32,711 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:35:32,732 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:35:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:43.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 03:35:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:43 UTC)" (scheduled at 2024-04-22 03:35:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 33, 760272), True, datetime.datetime(2024, 4, 22, 3, 35, 33, 760272), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:35:33,858 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:35:34,191 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:35:34,193 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:35:34,196 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:35:35,011 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:35:35,162 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:35:35,371 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:56.873109+00:00 (in 21.000770 seconds)
securityworker stdout | 2024-04-22 03:35:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:05 UTC)" (scheduled at 2024-04-22 03:35:35.871852+00:00)
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:35:36,160 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:35:37,559 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:35:37,626 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:35:38,046 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:35:38,226 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:35:39,262 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:41.564959+00:00 (in 1.997542 seconds)
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:39 UTC)" (scheduled at 2024-04-22 03:35:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:35:40,376 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:35:40,379 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:35:40,381 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:35:40,384 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:35:40,388 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:35:40,392 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:35:40,395 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:35:40,399 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:35:40,402 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:35:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:35:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:11.264267+00:00 (in 29.999400 seconds)
autopruneworker stdout | 2024-04-22 03:35:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:11 UTC)" (scheduled at 2024-04-22 03:35:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:35:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756881272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:35:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:35:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:35:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:39.566970+00:00 (in 58.001544 seconds)
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:41 UTC)" (scheduled at 2024-04-22 03:35:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:35:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 41, 565700), True, datetime.datetime(2024, 4, 22, 3, 35, 41, 565700), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:35:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:35:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:35:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:22.058978+00:00 (in 39.001330 seconds)
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:43 UTC)" (scheduled at 2024-04-22 03:35:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:35:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 43, 57910), True, datetime.datetime(2024, 4, 22, 3, 35, 43, 57910), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:35:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:35:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:35:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:35:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:53.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:35:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:53 UTC)" (scheduled at 2024-04-22 03:35:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 43, 760534), True, datetime.datetime(2024, 4, 22, 3, 35, 43, 760534), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:35:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:35:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:14.952062+00:00 (in 29.999538 seconds)
gcworker stdout | 2024-04-22 03:35:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:14 UTC)" (scheduled at 2024-04-22 03:35:44.952062+00:00)
gcworker stdout | 2024-04-22 03:35:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:35:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:35:45,653 [282] [DEBUG] [app] Starting request: urn:request:0bb6b544-0a15-4519-9513-49c060357489 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:45,653 [279] [DEBUG] [app] Starting request: urn:request:44fddcd8-2fdf-4a15-9bfa-2aeb0ab3a0aa (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:45,656 [284] [DEBUG] [app] Starting request: urn:request:b5512c1c-5137-4687-957f-eec341ed54cf (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [292] [DEBUG] [app] Starting request: urn:request:836545ec-8c7f-4c3a-a305-f14f2f267e33 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [284] [DEBUG] [app] Ending request: urn:request:b5512c1c-5137-4687-957f-eec341ed54cf (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b5512c1c-5137-4687-957f-eec341ed54cf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [292] [DEBUG] [app] Ending request: urn:request:836545ec-8c7f-4c3a-a305-f14f2f267e33 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:836545ec-8c7f-4c3a-a305-f14f2f267e33', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:35:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:45,660 [282] [DEBUG] [app] Starting request: urn:request:9767c05d-8d84-45d0-b406-5b5486fce3f6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:45,660 [282] [DEBUG] [app] Ending request: urn:request:9767c05d-8d84-45d0-b406-5b5486fce3f6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9767c05d-8d84-45d0-b406-5b5486fce3f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:45,660 [279] [DEBUG] [app] Starting request: urn:request:da3358ff-3bef-4da9-84a4-d75c429861c0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:35:45,661 [279] [DEBUG] [app] Ending request: urn:request:da3358ff-3bef-4da9-84a4-d75c429861c0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:da3358ff-3bef-4da9-84a4-d75c429861c0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:45,675 [282] [DEBUG] [app] Ending request: urn:request:0bb6b544-0a15-4519-9513-49c060357489 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0bb6b544-0a15-4519-9513-49c060357489', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:35:45,676 [279] [DEBUG] [app] Ending request: urn:request:44fddcd8-2fdf-4a15-9bfa-2aeb0ab3a0aa (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:44fddcd8-2fdf-4a15-9bfa-2aeb0ab3a0aa', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:45,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:45,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:35:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:35:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:17.052354+00:00 (in 29.999513 seconds)
buildlogsarchiver stdout | 2024-04-22 03:35:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:17 UTC)" (scheduled at 2024-04-22 03:35:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:35:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 35, 47, 53182), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:35:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:35:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:35:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:35:48,365 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:35:50,095 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:35:53,569 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:35:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:53,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:03.759375+00:00 (in 9.999366 seconds)
notificationworker stdout | 2024-04-22 03:35:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:03 UTC)" (scheduled at 2024-04-22 03:35:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 53, 760391), True, datetime.datetime(2024, 4, 22, 3, 35, 53, 760391), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:35:55,168 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:35:56,533 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:05.871852+00:00 (in 8.998269 seconds)
securityworker stdout | 2024-04-22 03:35:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:26 UTC)" (scheduled at 2024-04-22 03:35:56.873109+00:00)
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:35:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:35:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:35:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 30, 56, 881189), 1, 2])
securityworker stdout | 2024-04-22 03:35:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 30, 56, 881189), 1, 2])
securityworker stdout | 2024-04-22 03:35:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:35:58,558 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:35:58,565 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:35:59,589 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:35:59,600 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:35:59,603 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:35:59,608 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:35:59,612 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:35:59,677 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:36:00,653 [279] [DEBUG] [app] Starting request: urn:request:bbd34d67-da70-4c3f-968b-e562ce4d238a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:00,653 [278] [DEBUG] [app] Starting request: urn:request:ae8314e1-1c10-4704-bed6-89eb39357cff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:00,656 [284] [DEBUG] [app] Starting request: urn:request:6cd0dd64-cbe6-4e10-95b2-efbf90eef0e5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:00,656 [291] [DEBUG] [app] Starting request: urn:request:28cf7d87-a1bb-4afd-9bc5-f7f3af6fa0dd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [284] [DEBUG] [app] Ending request: urn:request:6cd0dd64-cbe6-4e10-95b2-efbf90eef0e5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6cd0dd64-cbe6-4e10-95b2-efbf90eef0e5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [291] [DEBUG] [app] Ending request: urn:request:28cf7d87-a1bb-4afd-9bc5-f7f3af6fa0dd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:28cf7d87-a1bb-4afd-9bc5-f7f3af6fa0dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:00,660 [279] [DEBUG] [app] Starting request: urn:request:8dd64209-53b9-499b-ae05-46aac9bebfed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:00,660 [279] [DEBUG] [app] Ending request: urn:request:8dd64209-53b9-499b-ae05-46aac9bebfed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8dd64209-53b9-499b-ae05-46aac9bebfed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:00,660 [282] [DEBUG] [app] Starting request: urn:request:18603f52-02c0-48f3-a254-7c5bdacc38d3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:00,661 [282] [DEBUG] [app] Ending request: urn:request:18603f52-02c0-48f3-a254-7c5bdacc38d3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:18603f52-02c0-48f3-a254-7c5bdacc38d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:00,676 [279] [DEBUG] [app] Ending request: urn:request:bbd34d67-da70-4c3f-968b-e562ce4d238a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bbd34d67-da70-4c3f-968b-e562ce4d238a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:36:00,676 [278] [DEBUG] [app] Ending request: urn:request:ae8314e1-1c10-4704-bed6-89eb39357cff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ae8314e1-1c10-4704-bed6-89eb39357cff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:36:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:36:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:36:01,053 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:36:02,423 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:16.552337+00:00 (in 13.995620 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:02 UTC)" (scheduled at 2024-04-22 03:36:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:36:02,736 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:36:02,768 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:36:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:13.759375+00:00 (in 9.999479 seconds)
notificationworker stdout | 2024-04-22 03:36:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:13 UTC)" (scheduled at 2024-04-22 03:36:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 3, 760140), True, datetime.datetime(2024, 4, 22, 3, 36, 3, 760140), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:03,780 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:03,780 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:03,780 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:36:03,894 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:36:04,199 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:36:04,203 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:36:04,208 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:36:05,048 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:36:05,199 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:36:05,407 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:26.873109+00:00 (in 21.000728 seconds)
securityworker stdout | 2024-04-22 03:36:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:35 UTC)" (scheduled at 2024-04-22 03:36:05.871852+00:00)
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:36:06,197 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:36:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:36:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:13.555667+00:00 (in 7.002705 seconds)
repositorygcworker stdout | 2024-04-22 03:36:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:06 UTC)" (scheduled at 2024-04-22 03:36:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:36:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:36:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 6, 553345), True, datetime.datetime(2024, 4, 22, 3, 36, 6, 553345), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:36:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:36:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:36:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:36:07,596 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:36:07,662 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:36:08,081 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:36:08,262 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:36:09,292 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:36:10,386 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:36:10,389 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:36:10,391 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:36:10,394 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:36:10,397 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:36:10,404 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:36:10,407 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:36:10,410 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:36:10,412 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:36:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:36:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:41.264267+00:00 (in 29.999466 seconds)
autopruneworker stdout | 2024-04-22 03:36:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:41 UTC)" (scheduled at 2024-04-22 03:36:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:36:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756911271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:36:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:36:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:36:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:36:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:51.555445+00:00 (in 37.999285 seconds)
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:13 UTC)" (scheduled at 2024-04-22 03:36:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:36:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:19.762424+00:00 (in 6.002594 seconds)
notificationworker stdout | 2024-04-22 03:36:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:23 UTC)" (scheduled at 2024-04-22 03:36:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 13, 760099), True, datetime.datetime(2024, 4, 22, 3, 36, 13, 760099), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:36:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:36:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:44.952062+00:00 (in 29.999408 seconds)
gcworker stdout | 2024-04-22 03:36:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:44 UTC)" (scheduled at 2024-04-22 03:36:14.952062+00:00)
gcworker stdout | 2024-04-22 03:36:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:36:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:15,652 [281] [DEBUG] [app] Starting request: urn:request:d288aedf-f54f-4d6a-8e32-175376b715b3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:15,652 [279] [DEBUG] [app] Starting request: urn:request:1b57e970-b761-4b6d-a653-964985b76656 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:15,656 [292] [DEBUG] [app] Starting request: urn:request:dabbc0b6-a925-4033-85ef-8a919fa92d68 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:15,656 [292] [DEBUG] [app] Ending request: urn:request:dabbc0b6-a925-4033-85ef-8a919fa92d68 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:dabbc0b6-a925-4033-85ef-8a919fa92d68', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:36:15,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:15,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:36:15,657 [285] [DEBUG] [app] Starting request: urn:request:bf5c7841-3b47-46bb-9afd-6b93794a1056 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:15,657 [285] [DEBUG] [app] Ending request: urn:request:bf5c7841-3b47-46bb-9afd-6b93794a1056 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bf5c7841-3b47-46bb-9afd-6b93794a1056', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.003)
gunicorn-registry stdout | 2024-04-22 03:36:15,658 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:15,659 [282] [DEBUG] [app] Starting request: urn:request:6385181d-fa15-472e-bdc2-3de5fd714740 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:15,659 [282] [DEBUG] [app] Ending request: urn:request:6385181d-fa15-472e-bdc2-3de5fd714740 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6385181d-fa15-472e-bdc2-3de5fd714740', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:15,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:15,661 [282] [DEBUG] [app] Starting request: urn:request:10ef26db-205e-4ad5-9da5-596ccb4aa443 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:15,661 [282] [DEBUG] [app] Ending request: urn:request:10ef26db-205e-4ad5-9da5-596ccb4aa443 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:10ef26db-205e-4ad5-9da5-596ccb4aa443', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:36:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:15,674 [281] [DEBUG] [app] Ending request: urn:request:d288aedf-f54f-4d6a-8e32-175376b715b3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d288aedf-f54f-4d6a-8e32-175376b715b3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:15,674 [279] [DEBUG] [app] Ending request: urn:request:1b57e970-b761-4b6d-a653-964985b76656 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1b57e970-b761-4b6d-a653-964985b76656', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:36:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:02.556208+00:00 (in 46.003204 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:16 UTC)" (scheduled at 2024-04-22 03:36:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 16, 553320), True, datetime.datetime(2024, 4, 22, 3, 36, 16, 553320), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:36:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:36:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:47.052354+00:00 (in 29.999453 seconds)
buildlogsarchiver stdout | 2024-04-22 03:36:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:47 UTC)" (scheduled at 2024-04-22 03:36:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:36:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 36, 17, 53249), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:36:17,067 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:36:17,068 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:36:17,068 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:36:18,402 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:36:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:23.759375+00:00 (in 3.996421 seconds)
notificationworker stdout | 2024-04-22 03:36:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:19 UTC)" (scheduled at 2024-04-22 03:36:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:36:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:36:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:36:20,131 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:43.057186+00:00 (in 20.997711 seconds)
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:22 UTC)" (scheduled at 2024-04-22 03:36:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:36:23,600 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:36:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:33.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 03:36:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:33 UTC)" (scheduled at 2024-04-22 03:36:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 23, 760168), True, datetime.datetime(2024, 4, 22, 3, 36, 23, 760168), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:24.361582+00:00 (in 59.999473 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:24 UTC)" (scheduled at 2024-04-22 03:36:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:36:25,204 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:36:26,564 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:35.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 03:36:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:56 UTC)" (scheduled at 2024-04-22 03:36:26.873109+00:00)
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:36:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:36:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 31, 26, 881364), 1, 2])
securityworker stdout | 2024-04-22 03:36:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 31, 26, 881364), 1, 2])
securityworker stdout | 2024-04-22 03:36:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:36:28,595 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:36:28,597 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:36:29,597 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:36:29,608 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:36:29,611 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:36:29,614 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:36:29,619 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:36:29,707 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:36:30,653 [278] [DEBUG] [app] Starting request: urn:request:e45bc62d-f40f-420f-9dc6-d1e095ecc2db (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:30,653 [281] [DEBUG] [app] Starting request: urn:request:14957286-1f74-4f6e-ad1e-56c4ad72a5ba (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:30,656 [291] [DEBUG] [app] Starting request: urn:request:743eae80-a7ec-42da-8c02-7bfaf2d10b23 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [291] [DEBUG] [app] Ending request: urn:request:743eae80-a7ec-42da-8c02-7bfaf2d10b23 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:743eae80-a7ec-42da-8c02-7bfaf2d10b23', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [284] [DEBUG] [app] Starting request: urn:request:71dda9e4-d4f9-48c8-8e4b-ece0e02f439a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [284] [DEBUG] [app] Ending request: urn:request:71dda9e4-d4f9-48c8-8e4b-ece0e02f439a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:71dda9e4-d4f9-48c8-8e4b-ece0e02f439a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:36:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:36:30,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:36:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:30,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:30,660 [279] [DEBUG] [app] Starting request: urn:request:fd3b5d90-28a7-4749-842a-28298c1bc51c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:30,661 [279] [DEBUG] [app] Ending request: urn:request:fd3b5d90-28a7-4749-842a-28298c1bc51c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fd3b5d90-28a7-4749-842a-28298c1bc51c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:30,661 [282] [DEBUG] [app] Starting request: urn:request:da7ca97e-06df-4486-856b-c1ea91b0cbe2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:30,662 [282] [DEBUG] [app] Ending request: urn:request:da7ca97e-06df-4486-856b-c1ea91b0cbe2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:da7ca97e-06df-4486-856b-c1ea91b0cbe2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:36:30,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:30,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:30,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:30,676 [281] [DEBUG] [app] Ending request: urn:request:14957286-1f74-4f6e-ad1e-56c4ad72a5ba (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:14957286-1f74-4f6e-ad1e-56c4ad72a5ba', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:36:30,677 [278] [DEBUG] [app] Ending request: urn:request:e45bc62d-f40f-420f-9dc6-d1e095ecc2db (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e45bc62d-f40f-420f-9dc6-d1e095ecc2db', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:36:30,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:36:31,089 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:36:32,456 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:36:32,768 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:36:32,803 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:36:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:43.759375+00:00 (in 9.999506 seconds)
notificationworker stdout | 2024-04-22 03:36:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:43 UTC)" (scheduled at 2024-04-22 03:36:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 33, 760153), True, datetime.datetime(2024, 4, 22, 3, 36, 33, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:33,781 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:33,781 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:33,781 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:36:33,931 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:36:34,208 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:36:34,210 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:36:34,214 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:36:35,084 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:36:35,206 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:36:35,415 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:56.873109+00:00 (in 21.000726 seconds)
securityworker stdout | 2024-04-22 03:36:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:05 UTC)" (scheduled at 2024-04-22 03:36:35.871852+00:00)
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:36:36,233 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:36:37,613 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:36:37,698 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:36:38,119 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:36:38,296 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:36:39,306 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:41.564959+00:00 (in 1.997498 seconds)
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:39 UTC)" (scheduled at 2024-04-22 03:36:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:36:40,395 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:36:40,399 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:36:40,403 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:36:40,406 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:36:40,408 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:36:40,413 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:36:40,416 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:36:40,419 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:36:40,421 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:36:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:36:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:11.264267+00:00 (in 29.999447 seconds)
autopruneworker stdout | 2024-04-22 03:36:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:11 UTC)" (scheduled at 2024-04-22 03:36:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:36:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756941272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:36:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:36:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:36:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:53.566665+00:00 (in 12.001210 seconds)
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:41 UTC)" (scheduled at 2024-04-22 03:36:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:36:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 41, 565894), True, datetime.datetime(2024, 4, 22, 3, 36, 41, 565894), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:36:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:36:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:36:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:36:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:36:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:22.058978+00:00 (in 39.001263 seconds)
namespacegcworker stdout | 2024-04-22 03:36:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:43 UTC)" (scheduled at 2024-04-22 03:36:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:36:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:36:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 43, 58187), True, datetime.datetime(2024, 4, 22, 3, 36, 43, 58187), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:36:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:36:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:36:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:36:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:53.759375+00:00 (in 9.999503 seconds)
notificationworker stdout | 2024-04-22 03:36:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:53 UTC)" (scheduled at 2024-04-22 03:36:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 43, 760108), True, datetime.datetime(2024, 4, 22, 3, 36, 43, 760108), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:36:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:36:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:14.952062+00:00 (in 29.999478 seconds)
gcworker stdout | 2024-04-22 03:36:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:14 UTC)" (scheduled at 2024-04-22 03:36:44.952062+00:00)
gcworker stdout | 2024-04-22 03:36:44,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:36:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:45,652 [282] [DEBUG] [app] Starting request: urn:request:c31b5032-4013-47f8-8fcf-52829199f92c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:45,652 [281] [DEBUG] [app] Starting request: urn:request:2a39c68c-451d-494a-ac15-4a10bf459b89 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [291] [DEBUG] [app] Starting request: urn:request:706924fb-f0f3-44f0-8e3a-f76aa40dcf7b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [289] [DEBUG] [app] Starting request: urn:request:672c2644-0e18-4032-9d44-9bf6e4688cde (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [291] [DEBUG] [app] Ending request: urn:request:706924fb-f0f3-44f0-8e3a-f76aa40dcf7b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:706924fb-f0f3-44f0-8e3a-f76aa40dcf7b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [289] [DEBUG] [app] Ending request: urn:request:672c2644-0e18-4032-9d44-9bf6e4688cde (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:672c2644-0e18-4032-9d44-9bf6e4688cde', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:36:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:45,659 [279] [DEBUG] [app] Starting request: urn:request:d941b29c-75e1-4378-a444-c92dd0ae8cef (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:45,659 [278] [DEBUG] [app] Starting request: urn:request:100aaff9-1800-48ff-8d4e-44b443f2235d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:45,659 [279] [DEBUG] [app] Ending request: urn:request:d941b29c-75e1-4378-a444-c92dd0ae8cef (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d941b29c-75e1-4378-a444-c92dd0ae8cef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:45,659 [278] [DEBUG] [app] Ending request: urn:request:100aaff9-1800-48ff-8d4e-44b443f2235d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:100aaff9-1800-48ff-8d4e-44b443f2235d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:45,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:45,674 [281] [DEBUG] [app] Ending request: urn:request:2a39c68c-451d-494a-ac15-4a10bf459b89 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2a39c68c-451d-494a-ac15-4a10bf459b89', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:45,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 03:36:45,675 [282] [DEBUG] [app] Ending request: urn:request:c31b5032-4013-47f8-8fcf-52829199f92c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c31b5032-4013-47f8-8fcf-52829199f92c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:36:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:36:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:17.052354+00:00 (in 29.999493 seconds)
buildlogsarchiver stdout | 2024-04-22 03:36:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:17 UTC)" (scheduled at 2024-04-22 03:36:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:36:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 36, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:36:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:36:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:36:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:36:48,432 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:36:50,168 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:36:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:36:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:06.552482+00:00 (in 14.996529 seconds)
repositorygcworker stdout | 2024-04-22 03:36:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:51 UTC)" (scheduled at 2024-04-22 03:36:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:36:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:36:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), True, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:36:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), True, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:36:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:36:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:51 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:53,093 [279] [DEBUG] [app] Starting request: urn:request:0edc3db7-1e78-4930-925b-fbb5b1a32311 (/api/v1/user/initialize) {'X-Forwarded-For': '123.123.45.4, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 03:36:53,094 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:53,107 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['whuquay', 'quay+test@redhat.com', 1, 0])
gunicorn-web stdout | 2024-04-22 03:36:53,109 [279] [DEBUG] [data.model.user] Email and username are unique!
gunicorn-web stdout | 2024-04-22 03:36:53,110 [279] [DEBUG] [peewee] ('INSERT INTO "user" ("uuid", "username", "email", "verified", "organization", "robot", "invoice_email", "invalid_login_attempts", "last_invalid_login", "removed_tag_expiration_s", "enabled", "maximum_queued_builds_count", "creation_date") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "user"."id"', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'whuquay', 'quay+test@redhat.com', False, False, False, False, 0, datetime.datetime(2024, 4, 22, 3, 36, 53, 110242), 1209600, True, None, datetime.datetime(2024, 4, 22, 3, 36, 53, 110248)])
gunicorn-web stdout | 2024-04-22 03:36:53,352 [279] [DEBUG] [peewee] ('UPDATE "user" SET "uuid" = %s, "username" = %s, "password_hash" = %s, "email" = %s, "verified" = %s, "organization" = %s, "robot" = %s, "invoice_email" = %s, "invalid_login_attempts" = %s, "last_invalid_login" = %s, "removed_tag_expiration_s" = %s, "enabled" = %s, "maximum_queued_builds_count" = %s, "creation_date" = %s WHERE ("user"."id" = %s)', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'whuquay', '$2b$12$P7Hw.K7b5oixIIFbsTJdQuZRZLFV6L5NxVblLrzSGwcxGSgtBPUHy', 'quay+test@redhat.com', True, False, False, False, 0, datetime.datetime(2024, 4, 22, 3, 36, 53, 110242), 1209600, True, None, datetime.datetime(2024, 4, 22, 3, 36, 53, 110248), 1])
gunicorn-web stdout | 2024-04-22 03:36:53,359 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 03:36:53,362 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 03:36:53,364 [279] [DEBUG] [endpoints.common] Successfully signed in as user whuquay with uuid a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 03:36:53,365 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 03:36:53,365 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 03:36:53,367 [279] [DEBUG] [peewee] ('INSERT INTO "oauthapplication" ("client_id", "secure_client_secret", "fully_migrated", "redirect_uri", "application_uri", "organization_id", "name", "description") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "oauthapplication"."id"', ['whuquay', 'v0$$kFGIM9H7kf+Rl3MKn5Tbi+HIHVMsPRKcEDGed5rSoYNaBnhBZhbEec17PUnoXXQhTEuHnhY1P5WQ5jrz/J3UaL7fKfO6', False, '', '', 1, 'automation', 'Application token generated via /api/v1/user/initialize'])
gunicorn-web stdout | 2024-04-22 03:36:53,374 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."client_id", "t1"."secure_client_secret", "t1"."fully_migrated", "t1"."redirect_uri", "t1"."application_uri", "t1"."organization_id", "t1"."name", "t1"."description", "t1"."gravatar_email" FROM "oauthapplication" AS "t1" WHERE ("t1"."client_id" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:36:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:36:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:39.566970+00:00 (in 45.999830 seconds)
exportactionlogsworker stdout | 2024-04-22 03:36:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:53 UTC)" (scheduled at 2024-04-22 03:36:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:36:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:36:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), True, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:36:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), True, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:36:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:36:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:53 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:53,611 [279] [DEBUG] [peewee] ('INSERT INTO "oauthaccesstoken" ("uuid", "application_id", "authorized_user_id", "scope", "token_name", "token_code", "token_type", "expires_at", "data") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "oauthaccesstoken"."id"', ['4efe41d5-76c7-47ed-90e9-55c22c47da77', 1, 1, 'org:admin repo:admin repo:create repo:read repo:write super:user user:admin user:read', 'FUD2SYBDHOTT8HSMHW0G', '$2b$12$SzHDgJ9N3/8ZOyp8Gd4mq.M7CdxYwNQpUaUwKqU2L1lh4RimPu6l6', 'token', datetime.datetime(2024, 4, 22, 6, 6, 53, 374136), ''])
gunicorn-web stdout | 2024-04-22 03:36:53,617 [279] [DEBUG] [app] Ending request: urn:request:0edc3db7-1e78-4930-925b-fbb5b1a32311 (/api/v1/user/initialize) {'endpoint': 'web.user_initialize', 'request_id': 'urn:request:0edc3db7-1e78-4930-925b-fbb5b1a32311', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/initialize', 'path': '/api/v1/user/initialize', 'parameters': {}, 'json_body': {'username': 'whuquay', 'password': '[FILTERED]', 'email': 'quay+test@redhat.com', 'access_token': True}, 'confsha': '38f2adc2', 'user-agent': 'curl/8.4.0'}
gunicorn-web stdout | 2024-04-22 03:36:53,618 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:53,619 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:03:36:53 +0000] "POST /api/v1/user/initialize HTTP/1.0" 200 200 "-" "curl/8.4.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:03:36:53 +0000] "POST /api/v1/user/initialize HTTP/1.1" 200 200 "-" "curl/8.4.0" (0.527 635 0.526)
builder stdout | 2024-04-22 03:36:53,622 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:36:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:03.759375+00:00 (in 9.999489 seconds)
notificationworker stdout | 2024-04-22 03:36:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:03 UTC)" (scheduled at 2024-04-22 03:36:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 53, 760227), True, datetime.datetime(2024, 4, 22, 3, 36, 53, 760227), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:36:55,229 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:36:56,599 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:05.871852+00:00 (in 8.998219 seconds)
securityworker stdout | 2024-04-22 03:36:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:26 UTC)" (scheduled at 2024-04-22 03:36:56.873109+00:00)
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:36:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:36:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 31, 56, 881484), 1, 2])
securityworker stdout | 2024-04-22 03:36:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 31, 56, 881484), 1, 2])
securityworker stdout | 2024-04-22 03:36:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:36:58,606 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:36:58,612 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:36:59,605 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:36:59,615 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:36:59,620 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:36:59,624 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:36:59,626 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:36:59,713 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:37:00,653 [279] [DEBUG] [app] Starting request: urn:request:b55cb159-0a59-48b0-8e25-5e8b2d6293e9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:00,653 [282] [DEBUG] [app] Starting request: urn:request:2d0fc917-a4f2-4b90-83bc-c9cc775ac5bb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [284] [DEBUG] [app] Starting request: urn:request:1e05d647-9ef8-4001-adb4-e29d0b1494d3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [292] [DEBUG] [app] Starting request: urn:request:bbf36180-1bf8-4da4-b7b9-530b12d07deb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [284] [DEBUG] [app] Ending request: urn:request:1e05d647-9ef8-4001-adb4-e29d0b1494d3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1e05d647-9ef8-4001-adb4-e29d0b1494d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [292] [DEBUG] [app] Ending request: urn:request:bbf36180-1bf8-4da4-b7b9-530b12d07deb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bbf36180-1bf8-4da4-b7b9-530b12d07deb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:37:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:37:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:00,659 [282] [DEBUG] [app] Starting request: urn:request:de2d37df-e8a8-4287-bc78-faf502debf0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:00,659 [279] [DEBUG] [app] Starting request: urn:request:08e6a886-e563-4a6a-8ac8-72c6c7d9c7ef (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:00,659 [282] [DEBUG] [app] Ending request: urn:request:de2d37df-e8a8-4287-bc78-faf502debf0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:de2d37df-e8a8-4287-bc78-faf502debf0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:00,660 [279] [DEBUG] [app] Ending request: urn:request:08e6a886-e563-4a6a-8ac8-72c6c7d9c7ef (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:08e6a886-e563-4a6a-8ac8-72c6c7d9c7ef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:00,674 [282] [DEBUG] [app] Ending request: urn:request:2d0fc917-a4f2-4b90-83bc-c9cc775ac5bb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2d0fc917-a4f2-4b90-83bc-c9cc775ac5bb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:37:00,675 [279] [DEBUG] [app] Ending request: urn:request:b55cb159-0a59-48b0-8e25-5e8b2d6293e9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b55cb159-0a59-48b0-8e25-5e8b2d6293e9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:37:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:37:01,097 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:37:02,477 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:16.552337+00:00 (in 13.995612 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:02 UTC)" (scheduled at 2024-04-22 03:37:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:37:02,788 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:37:02,824 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:37:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:13.759375+00:00 (in 9.999406 seconds)
notificationworker stdout | 2024-04-22 03:37:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:13 UTC)" (scheduled at 2024-04-22 03:37:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 3, 760409), True, datetime.datetime(2024, 4, 22, 3, 37, 3, 760409), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:37:03,968 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:37:04,216 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:37:04,218 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:37:04,221 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:37:05,122 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:37:05,241 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:37:05,442 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:37:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:26.873109+00:00 (in 21.000745 seconds)
securityworker stdout | 2024-04-22 03:37:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:35 UTC)" (scheduled at 2024-04-22 03:37:05.871852+00:00)
securityworker stdout | 2024-04-22 03:37:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:05,887 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:05,889 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:05,889 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:37:06,269 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:37:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:37:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:13.555667+00:00 (in 7.002684 seconds)
repositorygcworker stdout | 2024-04-22 03:37:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:06 UTC)" (scheduled at 2024-04-22 03:37:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:37:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:37:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 6, 553379), True, datetime.datetime(2024, 4, 22, 3, 37, 6, 553379), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:37:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:37:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:37:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:37:07,650 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:37:07,721 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:37:08,154 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:37:08,320 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:37:09,316 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:37:10,405 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:37:10,408 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:37:10,411 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:37:10,413 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:37:10,416 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:37:10,423 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:37:10,425 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:37:10,429 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:37:10,432 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:37:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:37:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:41.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 03:37:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:41 UTC)" (scheduled at 2024-04-22 03:37:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:37:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756971272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:37:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:37:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:37:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:37:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:06.552482+00:00 (in 52.996307 seconds)
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:13 UTC)" (scheduled at 2024-04-22 03:37:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:37:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:19.762424+00:00 (in 6.002594 seconds)
notificationworker stdout | 2024-04-22 03:37:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:23 UTC)" (scheduled at 2024-04-22 03:37:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 13, 760213), True, datetime.datetime(2024, 4, 22, 3, 37, 13, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:37:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:37:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:44.952062+00:00 (in 29.999471 seconds)
gcworker stdout | 2024-04-22 03:37:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:44 UTC)" (scheduled at 2024-04-22 03:37:14.952062+00:00)
gcworker stdout | 2024-04-22 03:37:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:37:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:37:15,653 [279] [DEBUG] [app] Starting request: urn:request:31ad056e-f2e5-40b1-93b1-3e8b7f10b1ae (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:15,653 [281] [DEBUG] [app] Starting request: urn:request:6346e10a-724e-46e4-b0e8-77c27e377735 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [291] [DEBUG] [app] Starting request: urn:request:59a9c0ed-9f08-429f-a9f5-74f8698ce4b2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [291] [DEBUG] [app] Ending request: urn:request:59a9c0ed-9f08-429f-a9f5-74f8698ce4b2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:59a9c0ed-9f08-429f-a9f5-74f8698ce4b2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [284] [DEBUG] [app] Starting request: urn:request:4ac5956d-cc0b-4f78-9904-28d5a1e4326e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [284] [DEBUG] [app] Ending request: urn:request:4ac5956d-cc0b-4f78-9904-28d5a1e4326e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4ac5956d-cc0b-4f78-9904-28d5a1e4326e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:37:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:37:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:15,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:15,660 [278] [DEBUG] [app] Starting request: urn:request:ee65d6fa-c56c-45be-9ef3-ccf17a4cf0cd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:15,660 [278] [DEBUG] [app] Ending request: urn:request:ee65d6fa-c56c-45be-9ef3-ccf17a4cf0cd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ee65d6fa-c56c-45be-9ef3-ccf17a4cf0cd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:37:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:15,661 [282] [DEBUG] [app] Starting request: urn:request:9ddde028-b37a-43c7-ab0d-2cbbf09f43d7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:15,662 [282] [DEBUG] [app] Ending request: urn:request:9ddde028-b37a-43c7-ab0d-2cbbf09f43d7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9ddde028-b37a-43c7-ab0d-2cbbf09f43d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:15,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:15,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:15,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:15,675 [279] [DEBUG] [app] Ending request: urn:request:31ad056e-f2e5-40b1-93b1-3e8b7f10b1ae (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:31ad056e-f2e5-40b1-93b1-3e8b7f10b1ae', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:37:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:37:15,676 [281] [DEBUG] [app] Ending request: urn:request:6346e10a-724e-46e4-b0e8-77c27e377735 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6346e10a-724e-46e4-b0e8-77c27e377735', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:21.555879+00:00 (in 5.002953 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:16 UTC)" (scheduled at 2024-04-22 03:37:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 16, 553256), True, datetime.datetime(2024, 4, 22, 3, 37, 16, 553256), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:37:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:37:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:47.052354+00:00 (in 29.999540 seconds)
buildlogsarchiver stdout | 2024-04-22 03:37:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:47 UTC)" (scheduled at 2024-04-22 03:37:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:37:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 37, 17, 53199), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:37:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:37:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:37:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:37:18,463 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:37:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:23.759375+00:00 (in 3.996335 seconds)
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:19 UTC)" (scheduled at 2024-04-22 03:37:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:37:20,189 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:02.556208+00:00 (in 40.999787 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:21 UTC)" (scheduled at 2024-04-22 03:37:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), True, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), True, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,573 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,573 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:38.058708+00:00 (in 15.999206 seconds)
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:22 UTC)" (scheduled at 2024-04-22 03:37:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:37:23,651 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:37:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:33.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 03:37:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:33 UTC)" (scheduled at 2024-04-22 03:37:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 23, 760323), True, datetime.datetime(2024, 4, 22, 3, 37, 23, 760323), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:23,777 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:23,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:23,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:24.361582+00:00 (in 59.999500 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:24 UTC)" (scheduled at 2024-04-22 03:37:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:37:25,266 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:37:26,636 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:37:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:35.871852+00:00 (in 8.998247 seconds)
securityworker stdout | 2024-04-22 03:37:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:56 UTC)" (scheduled at 2024-04-22 03:37:26.873109+00:00)
securityworker stdout | 2024-04-22 03:37:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:37:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:37:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 32, 26, 882339), 1, 2])
securityworker stdout | 2024-04-22 03:37:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 32, 26, 882339), 1, 2])
securityworker stdout | 2024-04-22 03:37:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:26,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:26,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:37:28,629 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:37:28,650 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:37:29,614 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:37:29,624 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:37:29,629 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:37:29,633 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:37:29,637 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:37:29,745 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:37:30,653 [282] [DEBUG] [app] Starting request: urn:request:5e766977-4829-4427-9c0a-4d18e47df82e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:30,653 [281] [DEBUG] [app] Starting request: urn:request:77ed2d7e-b381-42ca-8e44-55cafa381829 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:30,657 [292] [DEBUG] [app] Starting request: urn:request:25ff8e0b-2679-4cd2-9769-cfbb2acfb225 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:30,657 [292] [DEBUG] [app] Ending request: urn:request:25ff8e0b-2679-4cd2-9769-cfbb2acfb225 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:25ff8e0b-2679-4cd2-9769-cfbb2acfb225', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [284] [DEBUG] [app] Starting request: urn:request:062da6a8-8e48-42bb-858b-506144e8a870 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [284] [DEBUG] [app] Ending request: urn:request:062da6a8-8e48-42bb-858b-506144e8a870 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:062da6a8-8e48-42bb-858b-506144e8a870', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:30,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:37:30,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:30,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:30,661 [282] [DEBUG] [app] Starting request: urn:request:c5627bd8-9bb8-4aca-b7ec-22ad818bc132 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:30,662 [278] [DEBUG] [app] Starting request: urn:request:046be15b-e932-47e2-8ee2-392698f76dc0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:30,662 [282] [DEBUG] [app] Ending request: urn:request:c5627bd8-9bb8-4aca-b7ec-22ad818bc132 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c5627bd8-9bb8-4aca-b7ec-22ad818bc132', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:30,662 [278] [DEBUG] [app] Ending request: urn:request:046be15b-e932-47e2-8ee2-392698f76dc0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:046be15b-e932-47e2-8ee2-392698f76dc0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:30,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:30,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:30,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:30,663 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:30,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:30,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:30,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:30,678 [282] [DEBUG] [app] Ending request: urn:request:5e766977-4829-4427-9c0a-4d18e47df82e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5e766977-4829-4427-9c0a-4d18e47df82e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:30,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:30,678 [281] [DEBUG] [app] Ending request: urn:request:77ed2d7e-b381-42ca-8e44-55cafa381829 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:77ed2d7e-b381-42ca-8e44-55cafa381829', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:30,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:30,679 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:37:30,679 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.026)
notificationworker stdout | 2024-04-22 03:37:31,136 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:37:32,485 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:37:32,824 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:37:32,861 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:37:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:43.759375+00:00 (in 9.999488 seconds)
notificationworker stdout | 2024-04-22 03:37:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:43 UTC)" (scheduled at 2024-04-22 03:37:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 33, 760298), True, datetime.datetime(2024, 4, 22, 3, 37, 33, 760298), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:37:34,005 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:37:34,223 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:37:34,226 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:37:34,230 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:37:35,137 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:37:35,270 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:37:35,464 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:37:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:56.873109+00:00 (in 21.000795 seconds)
securityworker stdout | 2024-04-22 03:37:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:05 UTC)" (scheduled at 2024-04-22 03:37:35.871852+00:00)
securityworker stdout | 2024-04-22 03:37:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:35,887 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:35,889 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:35,889 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:37:36,300 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:37:37,687 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:37:37,755 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:37:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:37:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:43.057186+00:00 (in 4.998036 seconds)
namespacegcworker stdout | 2024-04-22 03:37:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:38 UTC)" (scheduled at 2024-04-22 03:37:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:37:38,059 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:37:38,069 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), True, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:37:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), True, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:37:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:37:38,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:38 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 03:37:38,190 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:37:38,355 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:37:39,352 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:41.564959+00:00 (in 1.997558 seconds)
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:39 UTC)" (scheduled at 2024-04-22 03:37:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:37:40,414 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:37:40,420 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:37:40,423 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:37:40,426 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:37:40,429 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:37:40,433 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:37:40,438 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:37:40,441 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:37:40,443 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:37:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:37:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:11.264267+00:00 (in 29.999460 seconds)
autopruneworker stdout | 2024-04-22 03:37:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:11 UTC)" (scheduled at 2024-04-22 03:37:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:37:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757001271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:37:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:37:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:37:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:39.566970+00:00 (in 58.001556 seconds)
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:41 UTC)" (scheduled at 2024-04-22 03:37:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:37:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 41, 565828), True, datetime.datetime(2024, 4, 22, 3, 37, 41, 565828), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:37:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:37:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:37:41,578 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:22.058978+00:00 (in 39.001342 seconds)
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:43 UTC)" (scheduled at 2024-04-22 03:37:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:37:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 43, 57909), True, datetime.datetime(2024, 4, 22, 3, 37, 43, 57909), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:37:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:37:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:37:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:37:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:53.759375+00:00 (in 9.999458 seconds)
notificationworker stdout | 2024-04-22 03:37:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:53 UTC)" (scheduled at 2024-04-22 03:37:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 43, 760359), True, datetime.datetime(2024, 4, 22, 3, 37, 43, 760359), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:37:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:37:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:14.952062+00:00 (in 29.999507 seconds)
gcworker stdout | 2024-04-22 03:37:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:14 UTC)" (scheduled at 2024-04-22 03:37:44.952062+00:00)
gcworker stdout | 2024-04-22 03:37:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:37:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:37:45,653 [282] [DEBUG] [app] Starting request: urn:request:be2d5411-b224-4c7f-8837-af5042cb47fd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:45,653 [278] [DEBUG] [app] Starting request: urn:request:7a3179d7-eda2-4569-a27b-33f74479c13a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:45,656 [292] [DEBUG] [app] Starting request: urn:request:44d54805-63e0-42a4-9b92-934118ece961 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:45,656 [284] [DEBUG] [app] Starting request: urn:request:93417f55-9cd9-483b-9f58-c9fe50446028 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [292] [DEBUG] [app] Ending request: urn:request:44d54805-63e0-42a4-9b92-934118ece961 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:44d54805-63e0-42a4-9b92-934118ece961', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [284] [DEBUG] [app] Ending request: urn:request:93417f55-9cd9-483b-9f58-c9fe50446028 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:93417f55-9cd9-483b-9f58-c9fe50446028', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:37:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:45,660 [282] [DEBUG] [app] Starting request: urn:request:7b11a471-2918-4249-b694-a762184086bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:45,660 [282] [DEBUG] [app] Ending request: urn:request:7b11a471-2918-4249-b694-a762184086bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7b11a471-2918-4249-b694-a762184086bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:45,661 [279] [DEBUG] [app] Starting request: urn:request:661b1635-84a8-4136-ac38-f97b4c4e37e6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:45,662 [279] [DEBUG] [app] Ending request: urn:request:661b1635-84a8-4136-ac38-f97b4c4e37e6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:661b1635-84a8-4136-ac38-f97b4c4e37e6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:45,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:37:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:45,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:45,675 [282] [DEBUG] [app] Ending request: urn:request:be2d5411-b224-4c7f-8837-af5042cb47fd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be2d5411-b224-4c7f-8837-af5042cb47fd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:37:45,677 [278] [DEBUG] [app] Ending request: urn:request:7a3179d7-eda2-4569-a27b-33f74479c13a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7a3179d7-eda2-4569-a27b-33f74479c13a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:45,678 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:45,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:37:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:37:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:17.052354+00:00 (in 29.999542 seconds)
buildlogsarchiver stdout | 2024-04-22 03:37:47,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:17 UTC)" (scheduled at 2024-04-22 03:37:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:37:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 37, 47, 53067), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:37:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:37:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:37:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:37:48,490 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:37:50,226 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:37:53,675 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:37:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:03.759375+00:00 (in 9.999456 seconds)
notificationworker stdout | 2024-04-22 03:37:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:03 UTC)" (scheduled at 2024-04-22 03:37:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 53, 760180), True, datetime.datetime(2024, 4, 22, 3, 37, 53, 760180), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:37:55,274 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:37:56,672 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:37:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:05.871852+00:00 (in 8.998181 seconds)
securityworker stdout | 2024-04-22 03:37:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:26 UTC)" (scheduled at 2024-04-22 03:37:56.873109+00:00)
securityworker stdout | 2024-04-22 03:37:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:37:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:37:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 32, 56, 881371), 1, 2])
securityworker stdout | 2024-04-22 03:37:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 32, 56, 881371), 1, 2])
securityworker stdout | 2024-04-22 03:37:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:37:58,643 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:37:58,673 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:37:59,624 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:37:59,632 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:37:59,636 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:37:59,640 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:37:59,647 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:37:59,754 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:38:00,653 [282] [DEBUG] [app] Starting request: urn:request:606c3805-b8f1-40aa-a819-e2da6b2dc77f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:00,653 [278] [DEBUG] [app] Starting request: urn:request:30aad967-e92f-4c42-aaaf-abcaa1ad71ff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [291] [DEBUG] [app] Starting request: urn:request:e86fa833-c3d1-41a8-bbba-9d6f0b69f362 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [289] [DEBUG] [app] Starting request: urn:request:0f5eb6b3-a4f6-4029-b09e-8986f3b6b0db (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [291] [DEBUG] [app] Ending request: urn:request:e86fa833-c3d1-41a8-bbba-9d6f0b69f362 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e86fa833-c3d1-41a8-bbba-9d6f0b69f362', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [289] [DEBUG] [app] Ending request: urn:request:0f5eb6b3-a4f6-4029-b09e-8986f3b6b0db (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0f5eb6b3-a4f6-4029-b09e-8986f3b6b0db', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:00,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:38:00,658 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:38:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [DEBUG] [app] Starting request: urn:request:eb49706a-0014-461f-9860-4d1a2f84ea79 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [DEBUG] [app] Ending request: urn:request:eb49706a-0014-461f-9860-4d1a2f84ea79 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eb49706a-0014-461f-9860-4d1a2f84ea79', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [281] [DEBUG] [app] Starting request: urn:request:8e250ace-042c-4856-9919-8b930f74ae80 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:00,661 [281] [DEBUG] [app] Ending request: urn:request:8e250ace-042c-4856-9919-8b930f74ae80 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8e250ace-042c-4856-9919-8b930f74ae80', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:38:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:00,676 [282] [DEBUG] [app] Ending request: urn:request:606c3805-b8f1-40aa-a819-e2da6b2dc77f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:606c3805-b8f1-40aa-a819-e2da6b2dc77f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:38:00,677 [278] [DEBUG] [app] Ending request: urn:request:30aad967-e92f-4c42-aaaf-abcaa1ad71ff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:30aad967-e92f-4c42-aaaf-abcaa1ad71ff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:00,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:38:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:38:01,158 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:38:02,521 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:16.552337+00:00 (in 13.995673 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:02 UTC)" (scheduled at 2024-04-22 03:38:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:38:02,860 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:38:02,898 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:38:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:13.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 03:38:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:13 UTC)" (scheduled at 2024-04-22 03:38:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 3, 760333), True, datetime.datetime(2024, 4, 22, 3, 38, 3, 760333), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:38:04,042 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:38:04,053 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 03:38:04,053 [93] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2024-04-22 03:38:04 UTC)" (scheduled at 2024-04-22 03:38:04.053182+00:00)
servicekey stdout | 2024-04-22 03:38:04,054 [93] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:04.053182+00:00 (in 3299.998967 seconds)
servicekey stdout | 2024-04-22 03:38:04,054 [93] [DEBUG] [__main__] Starting automatic refresh of service key DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk to new expiration 2024-04-22 05:38:04.054063
servicekey stdout | 2024-04-22 03:38:04,055 [93] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE (("t1"."kid" = %s) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s))) LIMIT %s OFFSET %s', ['DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk', datetime.datetime(2024, 4, 15, 3, 38, 4, 54774), None, 1, 0])
servicekey stdout | 2024-04-22 03:38:04,066 [93] [DEBUG] [peewee] ('UPDATE "servicekey" SET "name" = %s, "kid" = %s, "service" = %s, "jwk" = %s, "metadata" = %s, "created_date" = %s, "expiration_date" = %s, "rotation_duration" = %s, "approval_id" = %s WHERE ("servicekey"."id" = %s)', ['https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com:443', 'DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk', 'quay', '{"n": "yBslD6e149PD2fCkAyl_k2sShwjXRoZTDbR9aTxM8kATDI1EFad_7kKCQ1P9tQj8f9-axTqqskEjSwBb8wQoe1mAK4S6OVGkB3VWEs8DgkaIIc9NVpNkbdt9LLN1xUu-R5Jnd6NOx8sBUIQV_-U2skBKBud9QOEPQH2-1oa9ycLVX3a_l-nYwCEOaDKBcm__X1UUSKmzg31zbE1ru-Uhf3DAY_a4kZnulkyjtsAMh_3Ew8XhmAcHXqXTii5LlYtzLTMmzTZJfJ2YJ8tGiPzW9-ynbQ2oH1hF-n4sdIlgcU5TKeaAM1pmFlQ1L5uay3TIkYJ0hzpdqEVFO0QkSY4Ipw", "e": "AQAB", "kty": "RSA", "kid": "DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk"}', '{"created_by": "CLI tool"}', datetime.datetime(2024, 4, 22, 3, 33, 19, 436611), datetime.datetime(2024, 4, 22, 5, 38, 4, 54063), None, 2, 2])
servicekey stdout | 2024-04-22 03:38:04,070 [93] [DEBUG] [__main__] Finished automatic refresh of service key DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk with new expiration 2024-04-22 05:38:04.054063
servicekey stdout | 2024-04-22 03:38:04,070 [93] [DEBUG] [data.database] Disconnecting from database.
servicekey stdout | 2024-04-22 03:38:04,070 [93] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2024-04-22 04:33:04 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:38:04,232 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:38:04,234 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:38:04,237 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:38:05,169 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:38:05,307 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:38:05,496 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:38:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:26.873109+00:00 (in 21.000741 seconds)
securityworker stdout | 2024-04-22 03:38:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:35 UTC)" (scheduled at 2024-04-22 03:38:05.871852+00:00)
securityworker stdout | 2024-04-22 03:38:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:05,876 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:38:06,330 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:38:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:38:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:13.555667+00:00 (in 7.002731 seconds)
repositorygcworker stdout | 2024-04-22 03:38:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:06 UTC)" (scheduled at 2024-04-22 03:38:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:38:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:38:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 6, 553366), True, datetime.datetime(2024, 4, 22, 3, 38, 6, 553366), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:38:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:38:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:38:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:38:07,724 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:38:07,793 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:38:08,202 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:38:08,393 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:38:09,388 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:38:10,422 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:38:10,431 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:38:10,435 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:38:10,438 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:38:10,441 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:38:10,444 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:38:10,451 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:38:10,454 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:38:10,456 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:38:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:38:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:41.264267+00:00 (in 29.999508 seconds)
autopruneworker stdout | 2024-04-22 03:38:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:41 UTC)" (scheduled at 2024-04-22 03:38:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:38:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757031271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:38:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:38:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:38:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:38:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:06.552482+00:00 (in 52.996349 seconds)
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:13 UTC)" (scheduled at 2024-04-22 03:38:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:38:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:19.762160+00:00 (in 6.002280 seconds)
notificationworker stdout | 2024-04-22 03:38:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:23 UTC)" (scheduled at 2024-04-22 03:38:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 13, 760346), True, datetime.datetime(2024, 4, 22, 3, 38, 13, 760346), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:38:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:38:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:44.952062+00:00 (in 29.999520 seconds)
gcworker stdout | 2024-04-22 03:38:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:44 UTC)" (scheduled at 2024-04-22 03:38:14.952062+00:00)
gcworker stdout | 2024-04-22 03:38:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:38:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:38:15,653 [278] [DEBUG] [app] Starting request: urn:request:2a6a47ac-469c-4236-8070-f3b48c6592d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:15,653 [281] [DEBUG] [app] Starting request: urn:request:9757235e-278c-400a-b7c7-ccd7c8d54ffb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:15,657 [284] [DEBUG] [app] Starting request: urn:request:9f102059-dbf7-4c75-8316-aa6c1b298321 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:15,657 [292] [DEBUG] [app] Starting request: urn:request:7c575ef3-9741-4487-844a-5c8d0d59f1c5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [284] [DEBUG] [app] Ending request: urn:request:9f102059-dbf7-4c75-8316-aa6c1b298321 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9f102059-dbf7-4c75-8316-aa6c1b298321', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [292] [DEBUG] [app] Ending request: urn:request:7c575ef3-9741-4487-844a-5c8d0d59f1c5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7c575ef3-9741-4487-844a-5c8d0d59f1c5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:38:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:15,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [DEBUG] [app] Starting request: urn:request:ebecba5a-28ae-40fe-af72-2ebf6846b9d9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [DEBUG] [app] Ending request: urn:request:ebecba5a-28ae-40fe-af72-2ebf6846b9d9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ebecba5a-28ae-40fe-af72-2ebf6846b9d9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:15,662 [282] [DEBUG] [app] Starting request: urn:request:cb91aa14-b176-40f2-ae3c-016e2aed72db (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:15,662 [282] [DEBUG] [app] Ending request: urn:request:cb91aa14-b176-40f2-ae3c-016e2aed72db (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:cb91aa14-b176-40f2-ae3c-016e2aed72db', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:15,663 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:15,663 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:38:15,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:15,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:15,671 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:15,680 [281] [DEBUG] [app] Ending request: urn:request:9757235e-278c-400a-b7c7-ccd7c8d54ffb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9757235e-278c-400a-b7c7-ccd7c8d54ffb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:15,680 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:15,680 [278] [DEBUG] [app] Ending request: urn:request:2a6a47ac-469c-4236-8070-f3b48c6592d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2a6a47ac-469c-4236-8070-f3b48c6592d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:15,680 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:38:15,680 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.029 118 0.029)
gunicorn-web stdout | 2024-04-22 03:38:15,681 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:02.556208+00:00 (in 46.003329 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:16 UTC)" (scheduled at 2024-04-22 03:38:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,553 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 16, 553121), True, datetime.datetime(2024, 4, 22, 3, 38, 16, 553121), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:38:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:38:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:47.052354+00:00 (in 29.999525 seconds)
buildlogsarchiver stdout | 2024-04-22 03:38:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:47 UTC)" (scheduled at 2024-04-22 03:38:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:38:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 38, 17, 53179), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:38:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:38:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:38:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:38:18,527 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:38:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:43:19 UTC)" (scheduled at 2024-04-22 03:38:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:38:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 'notification/%'])
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:19 UTC)" (scheduled at 2024-04-22 03:38:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:23.759375+00:00 (in 3.995005 seconds)
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:38:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), True, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:38:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), True, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 'notification/%'])
notificationworker stdout | 2024-04-22 03:38:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:19,780 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:43:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:38:20,244 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:43.057186+00:00 (in 20.997707 seconds)
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:22 UTC)" (scheduled at 2024-04-22 03:38:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:38:23,682 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:38:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:23,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:33.759375+00:00 (in 9.999252 seconds)
notificationworker stdout | 2024-04-22 03:38:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:33 UTC)" (scheduled at 2024-04-22 03:38:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 23, 760571), True, datetime.datetime(2024, 4, 22, 3, 38, 23, 760571), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:24 UTC)" (scheduled at 2024-04-22 03:38:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:38:25,310 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:38:26,710 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:35.871852+00:00 (in 8.998274 seconds)
securityworker stdout | 2024-04-22 03:38:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:56 UTC)" (scheduled at 2024-04-22 03:38:26.873109+00:00)
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:38:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:38:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:38:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 33, 26, 881451), 1, 2])
securityworker stdout | 2024-04-22 03:38:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 33, 26, 881451), 1, 2])
securityworker stdout | 2024-04-22 03:38:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:38:28,657 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:38:28,708 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:38:29,634 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:38:29,644 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:38:29,647 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:38:29,652 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:38:29,656 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:38:29,762 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:38:30,653 [278] [DEBUG] [app] Starting request: urn:request:9dbeea7b-abe6-44e9-875f-f93e72b42797 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:30,653 [279] [DEBUG] [app] Starting request: urn:request:efa12b0a-dfee-484f-92e4-741832a8a0e2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:30,656 [284] [DEBUG] [app] Starting request: urn:request:e307d164-b613-453c-b3b6-49efc82facd2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:30,656 [291] [DEBUG] [app] Starting request: urn:request:3e3f66c9-d2d9-4abb-b60b-764768543e50 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:30,656 [284] [DEBUG] [app] Ending request: urn:request:e307d164-b613-453c-b3b6-49efc82facd2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e307d164-b613-453c-b3b6-49efc82facd2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:30,657 [291] [DEBUG] [app] Ending request: urn:request:3e3f66c9-d2d9-4abb-b60b-764768543e50 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3e3f66c9-d2d9-4abb-b60b-764768543e50', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:38:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:38:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:30,659 [278] [DEBUG] [app] Starting request: urn:request:3a97330e-b3c4-43c2-afc4-7dc0b6781ddd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:30,660 [278] [DEBUG] [app] Ending request: urn:request:3a97330e-b3c4-43c2-afc4-7dc0b6781ddd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3a97330e-b3c4-43c2-afc4-7dc0b6781ddd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:30,660 [282] [DEBUG] [app] Starting request: urn:request:4f1cc91e-e13c-44f5-838d-06079ab9cc3a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:30,661 [282] [DEBUG] [app] Ending request: urn:request:4f1cc91e-e13c-44f5-838d-06079ab9cc3a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4f1cc91e-e13c-44f5-838d-06079ab9cc3a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:38:30,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:30,675 [278] [DEBUG] [app] Ending request: urn:request:9dbeea7b-abe6-44e9-875f-f93e72b42797 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9dbeea7b-abe6-44e9-875f-f93e72b42797', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:38:30,676 [279] [DEBUG] [app] Ending request: urn:request:efa12b0a-dfee-484f-92e4-741832a8a0e2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:efa12b0a-dfee-484f-92e4-741832a8a0e2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:30,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:30,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:38:31,187 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:38:32,558 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:38:32,897 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:38:32,933 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:38:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:43.759375+00:00 (in 9.999419 seconds)
notificationworker stdout | 2024-04-22 03:38:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:43 UTC)" (scheduled at 2024-04-22 03:38:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 33, 760412), True, datetime.datetime(2024, 4, 22, 3, 38, 33, 760412), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:38:34,078 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:38:34,242 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:38:34,246 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:38:34,249 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:38:35,205 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:38:35,344 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:38:35,516 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:56.873109+00:00 (in 21.000778 seconds)
securityworker stdout | 2024-04-22 03:38:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:05 UTC)" (scheduled at 2024-04-22 03:38:35.871852+00:00)
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:35,874 [92] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quayregistry-clair-app.quay-enterprise.svc.cluster.local
securityworker stdout | 2024-04-22 03:38:35,883 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:35,884 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:35,893 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:38:36,345 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:38:37,761 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:38:37,830 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:38:38,238 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:38:38,430 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:38:39,425 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:41.564959+00:00 (in 1.997534 seconds)
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:39 UTC)" (scheduled at 2024-04-22 03:38:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:38:40,431 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:38:40,439 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:38:40,445 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:38:40,448 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:38:40,452 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:38:40,456 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:38:40,459 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:38:40,463 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:38:40,466 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:38:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:38:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:11.264267+00:00 (in 29.999519 seconds)
autopruneworker stdout | 2024-04-22 03:38:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:11 UTC)" (scheduled at 2024-04-22 03:38:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:38:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757061271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:38:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:38:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:38:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:39.566970+00:00 (in 58.001496 seconds)
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:41 UTC)" (scheduled at 2024-04-22 03:38:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:38:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 41, 565915), True, datetime.datetime(2024, 4, 22, 3, 38, 41, 565915), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:38:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:38:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:38:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:22.058978+00:00 (in 39.001254 seconds)
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:43 UTC)" (scheduled at 2024-04-22 03:38:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:38:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 43, 57998), True, datetime.datetime(2024, 4, 22, 3, 38, 43, 57998), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:38:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:38:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:38:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:38:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:53.759375+00:00 (in 9.999481 seconds)
notificationworker stdout | 2024-04-22 03:38:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:53 UTC)" (scheduled at 2024-04-22 03:38:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 43, 760289), True, datetime.datetime(2024, 4, 22, 3, 38, 43, 760289), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:38:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:38:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:14.952062+00:00 (in 29.999554 seconds)
gcworker stdout | 2024-04-22 03:38:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:14 UTC)" (scheduled at 2024-04-22 03:38:44.952062+00:00)
gcworker stdout | 2024-04-22 03:38:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:38:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:38:45,653 [278] [DEBUG] [app] Starting request: urn:request:b4f34a70-ab49-4e89-aff3-ab7c50fb8e29 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:45,653 [281] [DEBUG] [app] Starting request: urn:request:2eb8367a-a014-43dc-8489-c25686f355bb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:45,656 [290] [DEBUG] [app] Starting request: urn:request:bdc8b05a-0b0f-47f4-9f9c-0eeb8587be65 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [284] [DEBUG] [app] Starting request: urn:request:a6ba26fd-e10d-4ae8-8658-10e5479f9251 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [290] [DEBUG] [app] Ending request: urn:request:bdc8b05a-0b0f-47f4-9f9c-0eeb8587be65 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bdc8b05a-0b0f-47f4-9f9c-0eeb8587be65', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [284] [DEBUG] [app] Ending request: urn:request:a6ba26fd-e10d-4ae8-8658-10e5479f9251 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a6ba26fd-e10d-4ae8-8658-10e5479f9251', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:45,660 [282] [DEBUG] [app] Starting request: urn:request:fc4853b3-53c9-440e-bf72-6b6edd055938 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:45,661 [282] [DEBUG] [app] Ending request: urn:request:fc4853b3-53c9-440e-bf72-6b6edd055938 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fc4853b3-53c9-440e-bf72-6b6edd055938', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:45,661 [278] [DEBUG] [app] Starting request: urn:request:ff5f0fb7-de16-4067-b19f-97ab77ed8217 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:45,661 [278] [DEBUG] [app] Ending request: urn:request:ff5f0fb7-de16-4067-b19f-97ab77ed8217 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff5f0fb7-de16-4067-b19f-97ab77ed8217', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:45,676 [278] [DEBUG] [app] Ending request: urn:request:b4f34a70-ab49-4e89-aff3-ab7c50fb8e29 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b4f34a70-ab49-4e89-aff3-ab7c50fb8e29', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:38:45,677 [281] [DEBUG] [app] Ending request: urn:request:2eb8367a-a014-43dc-8489-c25686f355bb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2eb8367a-a014-43dc-8489-c25686f355bb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:45,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:45,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:38:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:38:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:17.052354+00:00 (in 29.999526 seconds)
buildlogsarchiver stdout | 2024-04-22 03:38:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:17 UTC)" (scheduled at 2024-04-22 03:38:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:38:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 38, 47, 53180), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:38:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:38:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:38:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:38:48,565 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:38:50,281 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:38:53,718 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:38:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:03.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 03:38:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:03 UTC)" (scheduled at 2024-04-22 03:38:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 53, 760343), True, datetime.datetime(2024, 4, 22, 3, 38, 53, 760343), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:53,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:38:55,346 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:38:56,732 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:05.871852+00:00 (in 8.998290 seconds)
securityworker stdout | 2024-04-22 03:38:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:26 UTC)" (scheduled at 2024-04-22 03:38:56.873109+00:00)
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:38:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:38:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 33, 56, 880864), 1, 2])
securityworker stdout | 2024-04-22 03:38:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 33, 56, 880864), 1, 2])
securityworker stdout | 2024-04-22 03:38:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:38:58,693 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:38:58,745 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:38:59,643 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:38:59,653 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:38:59,657 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:38:59,661 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:38:59,663 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:38:59,796 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:39:00,653 [278] [DEBUG] [app] Starting request: urn:request:60bc0680-6088-41b7-9349-99782c1c2049 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:00,653 [279] [DEBUG] [app] Starting request: urn:request:bacb75e6-71b2-4116-ba8e-4557bceba194 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:00,656 [291] [DEBUG] [app] Starting request: urn:request:0c6c2377-4de5-4bdc-8b06-b51e5e185cb2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:00,656 [291] [DEBUG] [app] Ending request: urn:request:0c6c2377-4de5-4bdc-8b06-b51e5e185cb2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0c6c2377-4de5-4bdc-8b06-b51e5e185cb2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:00,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:39:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:39:00,657 [286] [DEBUG] [app] Starting request: urn:request:e752ead9-addb-4ce4-9f56-a1bf9dfbba9f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:00,658 [286] [DEBUG] [app] Ending request: urn:request:e752ead9-addb-4ce4-9f56-a1bf9dfbba9f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e752ead9-addb-4ce4-9f56-a1bf9dfbba9f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.003)
gunicorn-registry stdout | 2024-04-22 03:39:00,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:00,659 [278] [DEBUG] [app] Starting request: urn:request:c6b58473-de3b-42c5-9b14-875521e01859 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:00,659 [278] [DEBUG] [app] Ending request: urn:request:c6b58473-de3b-42c5-9b14-875521e01859 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c6b58473-de3b-42c5-9b14-875521e01859', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:00,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:00,661 [282] [DEBUG] [app] Starting request: urn:request:b3a0a355-65c9-440f-97ca-5bd264f40a75 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:00,661 [282] [DEBUG] [app] Ending request: urn:request:b3a0a355-65c9-440f-97ca-5bd264f40a75 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b3a0a355-65c9-440f-97ca-5bd264f40a75', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:39:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:00,674 [278] [DEBUG] [app] Ending request: urn:request:60bc0680-6088-41b7-9349-99782c1c2049 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:60bc0680-6088-41b7-9349-99782c1c2049', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:39:00,675 [279] [DEBUG] [app] Ending request: urn:request:bacb75e6-71b2-4116-ba8e-4557bceba194 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bacb75e6-71b2-4116-ba8e-4557bceba194', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:39:01,195 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:16.552337+00:00 (in 13.995615 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:02 UTC)" (scheduled at 2024-04-22 03:39:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:39:02,568 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:39:02,929 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:39:02,962 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:39:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:03,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:13.759375+00:00 (in 9.999375 seconds)
notificationworker stdout | 2024-04-22 03:39:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:13 UTC)" (scheduled at 2024-04-22 03:39:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 3, 760504), True, datetime.datetime(2024, 4, 22, 3, 39, 3, 760504), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:39:04,114 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:39:04,249 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:39:04,252 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:39:04,255 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:39:05,242 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:39:05,353 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:39:05,552 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:26.873109+00:00 (in 21.000771 seconds)
securityworker stdout | 2024-04-22 03:39:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:35 UTC)" (scheduled at 2024-04-22 03:39:05.871852+00:00)
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:05,874 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:39:06,377 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:39:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:39:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:13.555667+00:00 (in 7.002693 seconds)
repositorygcworker stdout | 2024-04-22 03:39:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:06 UTC)" (scheduled at 2024-04-22 03:39:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:39:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:39:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 6, 553345), True, datetime.datetime(2024, 4, 22, 3, 39, 6, 553345), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:39:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:39:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:39:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:39:07,798 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:39:07,865 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:39:08,273 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:39:08,439 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:39:09,457 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:39:10,439 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:39:10,452 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:39:10,455 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:39:10,459 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:39:10,461 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:39:10,467 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:39:10,470 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:39:10,473 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:39:10,475 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:39:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:39:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:41.264267+00:00 (in 29.999505 seconds)
autopruneworker stdout | 2024-04-22 03:39:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:41 UTC)" (scheduled at 2024-04-22 03:39:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:39:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757091271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:39:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:39:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:39:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:39:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:06.552482+00:00 (in 52.996341 seconds)
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:13 UTC)" (scheduled at 2024-04-22 03:39:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:39:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:19.762424+00:00 (in 6.002512 seconds)
notificationworker stdout | 2024-04-22 03:39:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:23 UTC)" (scheduled at 2024-04-22 03:39:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 13, 760191), True, datetime.datetime(2024, 4, 22, 3, 39, 13, 760191), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:39:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:39:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:44.952062+00:00 (in 29.999441 seconds)
gcworker stdout | 2024-04-22 03:39:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:44 UTC)" (scheduled at 2024-04-22 03:39:14.952062+00:00)
gcworker stdout | 2024-04-22 03:39:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:39:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:39:15,653 [282] [DEBUG] [app] Starting request: urn:request:af7d9d73-91eb-43f1-a303-4a99f1cd42bd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:15,653 [281] [DEBUG] [app] Starting request: urn:request:07d59a58-3fb2-46a5-afbd-52285ca7007b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [289] [DEBUG] [app] Starting request: urn:request:0121c33c-2bf4-4ed9-a147-c93b2504fe9d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [291] [DEBUG] [app] Starting request: urn:request:5598dbd1-6aa3-488c-a279-52e43317139a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [289] [DEBUG] [app] Ending request: urn:request:0121c33c-2bf4-4ed9-a147-c93b2504fe9d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0121c33c-2bf4-4ed9-a147-c93b2504fe9d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [291] [DEBUG] [app] Ending request: urn:request:5598dbd1-6aa3-488c-a279-52e43317139a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5598dbd1-6aa3-488c-a279-52e43317139a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:39:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:15,659 [281] [DEBUG] [app] Starting request: urn:request:3f21ccc1-a6c8-4f7e-a850-e8f9686a1a92 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:15,659 [281] [DEBUG] [app] Ending request: urn:request:3f21ccc1-a6c8-4f7e-a850-e8f9686a1a92 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3f21ccc1-a6c8-4f7e-a850-e8f9686a1a92', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:15,659 [278] [DEBUG] [app] Starting request: urn:request:d096d9fc-fdb5-407f-8d5c-feac37a0e51c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:15,660 [278] [DEBUG] [app] Ending request: urn:request:d096d9fc-fdb5-407f-8d5c-feac37a0e51c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d096d9fc-fdb5-407f-8d5c-feac37a0e51c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:15,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:15,674 [281] [DEBUG] [app] Ending request: urn:request:07d59a58-3fb2-46a5-afbd-52285ca7007b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:07d59a58-3fb2-46a5-afbd-52285ca7007b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:39:15,677 [282] [DEBUG] [app] Ending request: urn:request:af7d9d73-91eb-43f1-a303-4a99f1cd42bd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:af7d9d73-91eb-43f1-a303-4a99f1cd42bd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:15,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:15,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:02.556208+00:00 (in 46.003270 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:16 UTC)" (scheduled at 2024-04-22 03:39:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 16, 553188), True, datetime.datetime(2024, 4, 22, 3, 39, 16, 553188), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:39:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:39:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:47.052354+00:00 (in 29.999445 seconds)
buildlogsarchiver stdout | 2024-04-22 03:39:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:47 UTC)" (scheduled at 2024-04-22 03:39:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:39:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 39, 17, 53286), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:39:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:39:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:39:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:39:18,601 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:39:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:23.759375+00:00 (in 3.996458 seconds)
notificationworker stdout | 2024-04-22 03:39:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:19 UTC)" (scheduled at 2024-04-22 03:39:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:39:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:39:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:39:20,288 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:43.057186+00:00 (in 20.997680 seconds)
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:22 UTC)" (scheduled at 2024-04-22 03:39:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:39:23,754 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:39:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:33.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 03:39:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:33 UTC)" (scheduled at 2024-04-22 03:39:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 23, 760335), True, datetime.datetime(2024, 4, 22, 3, 39, 23, 760335), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:24.361582+00:00 (in 59.999499 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:24 UTC)" (scheduled at 2024-04-22 03:39:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:39:25,360 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:39:26,768 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:39:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:35.871852+00:00 (in 8.998215 seconds)
securityworker stdout | 2024-04-22 03:39:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:56 UTC)" (scheduled at 2024-04-22 03:39:26.873109+00:00)
securityworker stdout | 2024-04-22 03:39:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:39:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:39:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 34, 26, 881899), 1, 2])
securityworker stdout | 2024-04-22 03:39:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 34, 26, 881899), 1, 2])
securityworker stdout | 2024-04-22 03:39:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:39:28,718 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:39:28,753 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:39:29,650 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:39:29,662 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:39:29,664 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:39:29,667 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:39:29,669 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:39:29,817 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:39:30,653 [281] [DEBUG] [app] Starting request: urn:request:b3cb6a99-8e09-4fce-a133-2040c0c8b338 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:30,653 [278] [DEBUG] [app] Starting request: urn:request:a977f235-7910-4190-86fd-24c72e930aa7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:30,656 [284] [DEBUG] [app] Starting request: urn:request:60656de9-ea0d-4282-bd9e-31ff36723a2c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:30,656 [292] [DEBUG] [app] Starting request: urn:request:48dc9613-c6d3-4c84-8ef7-aebeea94ded9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:30,656 [284] [DEBUG] [app] Ending request: urn:request:60656de9-ea0d-4282-bd9e-31ff36723a2c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:60656de9-ea0d-4282-bd9e-31ff36723a2c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:30,657 [292] [DEBUG] [app] Ending request: urn:request:48dc9613-c6d3-4c84-8ef7-aebeea94ded9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:48dc9613-c6d3-4c84-8ef7-aebeea94ded9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:39:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:39:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:30,659 [281] [DEBUG] [app] Starting request: urn:request:e2609e18-cba6-40f1-9a6b-590821852caf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:30,659 [281] [DEBUG] [app] Ending request: urn:request:e2609e18-cba6-40f1-9a6b-590821852caf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2609e18-cba6-40f1-9a6b-590821852caf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:30,660 [282] [DEBUG] [app] Starting request: urn:request:2e5cb652-ac39-49cb-8c77-d678284992cf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:30,660 [282] [DEBUG] [app] Ending request: urn:request:2e5cb652-ac39-49cb-8c77-d678284992cf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2e5cb652-ac39-49cb-8c77-d678284992cf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:30,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:30,675 [278] [DEBUG] [app] Ending request: urn:request:a977f235-7910-4190-86fd-24c72e930aa7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a977f235-7910-4190-86fd-24c72e930aa7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:39:30,678 [281] [DEBUG] [app] Ending request: urn:request:b3cb6a99-8e09-4fce-a133-2040c0c8b338 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b3cb6a99-8e09-4fce-a133-2040c0c8b338', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:30,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:30,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:39:31,226 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:39:32,603 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:39:32,936 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:39:32,998 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:39:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:43.759375+00:00 (in 9.999509 seconds)
notificationworker stdout | 2024-04-22 03:39:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:43 UTC)" (scheduled at 2024-04-22 03:39:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 33, 760287), True, datetime.datetime(2024, 4, 22, 3, 39, 33, 760287), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:39:34,150 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:39:34,257 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:39:34,259 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:39:34,262 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:39:35,264 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:39:35,378 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:39:35,589 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:39:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:56.873109+00:00 (in 21.000713 seconds)
securityworker stdout | 2024-04-22 03:39:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:05 UTC)" (scheduled at 2024-04-22 03:39:35.871852+00:00)
securityworker stdout | 2024-04-22 03:39:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:39:36,383 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:39:37,810 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:39:37,883 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:39:38,303 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:39:38,447 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:39:39,493 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:41.564959+00:00 (in 1.997448 seconds)
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:39 UTC)" (scheduled at 2024-04-22 03:39:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:39:40,450 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:39:40,462 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:39:40,465 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:39:40,469 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:39:40,473 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:39:40,476 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:39:40,478 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:39:40,482 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:39:40,485 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:39:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:39:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:11.264267+00:00 (in 29.999470 seconds)
autopruneworker stdout | 2024-04-22 03:39:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:11 UTC)" (scheduled at 2024-04-22 03:39:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:39:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757121272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:39:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:39:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:39:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:39.566970+00:00 (in 58.001546 seconds)
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:41 UTC)" (scheduled at 2024-04-22 03:39:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:39:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 41, 565776), True, datetime.datetime(2024, 4, 22, 3, 39, 41, 565776), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:39:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:39:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:39:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:22.058978+00:00 (in 39.001333 seconds)
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:43 UTC)" (scheduled at 2024-04-22 03:39:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:39:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 43, 57900), True, datetime.datetime(2024, 4, 22, 3, 39, 43, 57900), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:39:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:39:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:39:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:39:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:53.759375+00:00 (in 9.999523 seconds)
notificationworker stdout | 2024-04-22 03:39:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:53 UTC)" (scheduled at 2024-04-22 03:39:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 43, 760248), True, datetime.datetime(2024, 4, 22, 3, 39, 43, 760248), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:39:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:39:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:14.952062+00:00 (in 29.999468 seconds)
gcworker stdout | 2024-04-22 03:39:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:14 UTC)" (scheduled at 2024-04-22 03:39:44.952062+00:00)
gcworker stdout | 2024-04-22 03:39:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:39:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:39:45,652 [278] [DEBUG] [app] Starting request: urn:request:9df00f11-9d0c-481b-9606-2db1f0476d03 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:45,652 [282] [DEBUG] [app] Starting request: urn:request:e73fb46b-e459-46aa-b19f-efbd72b421c9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [284] [DEBUG] [app] Starting request: urn:request:7e6ff98a-717d-4913-93ab-5fb21cb00bd9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [292] [DEBUG] [app] Starting request: urn:request:cf317e15-b523-4ba5-89b0-e87b941f649c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [284] [DEBUG] [app] Ending request: urn:request:7e6ff98a-717d-4913-93ab-5fb21cb00bd9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7e6ff98a-717d-4913-93ab-5fb21cb00bd9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [292] [DEBUG] [app] Ending request: urn:request:cf317e15-b523-4ba5-89b0-e87b941f649c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf317e15-b523-4ba5-89b0-e87b941f649c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:39:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:45,659 [278] [DEBUG] [app] Starting request: urn:request:001f005b-bea7-4c12-a88e-d11deaeb652e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:45,659 [281] [DEBUG] [app] Starting request: urn:request:a3fbf655-b186-48d6-b996-cd7c0ac6ad43 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:45,659 [278] [DEBUG] [app] Ending request: urn:request:001f005b-bea7-4c12-a88e-d11deaeb652e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:001f005b-bea7-4c12-a88e-d11deaeb652e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:45,660 [281] [DEBUG] [app] Ending request: urn:request:a3fbf655-b186-48d6-b996-cd7c0ac6ad43 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a3fbf655-b186-48d6-b996-cd7c0ac6ad43', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:45,674 [282] [DEBUG] [app] Ending request: urn:request:e73fb46b-e459-46aa-b19f-efbd72b421c9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e73fb46b-e459-46aa-b19f-efbd72b421c9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 03:39:45,674 [278] [DEBUG] [app] Ending request: urn:request:9df00f11-9d0c-481b-9606-2db1f0476d03 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9df00f11-9d0c-481b-9606-2db1f0476d03', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:39:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:39:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:39:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:17.052354+00:00 (in 29.999495 seconds)
buildlogsarchiver stdout | 2024-04-22 03:39:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:17 UTC)" (scheduled at 2024-04-22 03:39:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:39:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 39, 47, 53221), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:39:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:39:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:39:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:39:48,638 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:39:50,325 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:39:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:03.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:39:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:03 UTC)" (scheduled at 2024-04-22 03:39:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 53, 760231), True, datetime.datetime(2024, 4, 22, 3, 39, 53, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:39:53,787 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:39:55,396 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:39:56,804 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:39:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:05.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 03:39:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:26 UTC)" (scheduled at 2024-04-22 03:39:56.873109+00:00)
securityworker stdout | 2024-04-22 03:39:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:39:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:39:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 34, 56, 881073), 1, 2])
securityworker stdout | 2024-04-22 03:39:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 34, 56, 881073), 1, 2])
securityworker stdout | 2024-04-22 03:39:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:39:58,755 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:39:58,784 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:39:59,658 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:39:59,669 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:39:59,672 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:39:59,676 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:39:59,678 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:39:59,852 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:40:00,652 [278] [DEBUG] [app] Starting request: urn:request:4f0c18c0-dde7-4a01-be1f-dcc1296fe97f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:00,652 [282] [DEBUG] [app] Starting request: urn:request:bef75971-7f86-42a5-b50e-de13248dbb85 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:00,656 [292] [DEBUG] [app] Starting request: urn:request:e0333e0b-409e-44f2-a57c-5c2cb16e5433 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:00,656 [292] [DEBUG] [app] Ending request: urn:request:e0333e0b-409e-44f2-a57c-5c2cb16e5433 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e0333e0b-409e-44f2-a57c-5c2cb16e5433', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:00,656 [284] [DEBUG] [app] Starting request: urn:request:fea122a6-4300-40a8-afbe-20cc2c09359e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:00,657 [284] [DEBUG] [app] Ending request: urn:request:fea122a6-4300-40a8-afbe-20cc2c09359e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fea122a6-4300-40a8-afbe-20cc2c09359e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:40:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:40:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:00,659 [281] [DEBUG] [app] Starting request: urn:request:57d45423-a9d7-446e-a8ae-1f168e5099c2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:00,660 [281] [DEBUG] [app] Ending request: urn:request:57d45423-a9d7-446e-a8ae-1f168e5099c2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:57d45423-a9d7-446e-a8ae-1f168e5099c2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:00,660 [278] [DEBUG] [app] Starting request: urn:request:3fc4be08-bb5a-4aca-af5c-e451e1c0ec58 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:00,661 [278] [DEBUG] [app] Ending request: urn:request:3fc4be08-bb5a-4aca-af5c-e451e1c0ec58 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3fc4be08-bb5a-4aca-af5c-e451e1c0ec58', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:00,676 [278] [DEBUG] [app] Ending request: urn:request:4f0c18c0-dde7-4a01-be1f-dcc1296fe97f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4f0c18c0-dde7-4a01-be1f-dcc1296fe97f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:00,676 [282] [DEBUG] [app] Ending request: urn:request:bef75971-7f86-42a5-b50e-de13248dbb85 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bef75971-7f86-42a5-b50e-de13248dbb85', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:40:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:40:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:40:01,260 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:16.552337+00:00 (in 13.995624 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:02 UTC)" (scheduled at 2024-04-22 03:40:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:40:02,640 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:40:02,954 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:40:03,034 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:40:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:13.759375+00:00 (in 9.999430 seconds)
notificationworker stdout | 2024-04-22 03:40:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:13 UTC)" (scheduled at 2024-04-22 03:40:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 3, 760469), True, datetime.datetime(2024, 4, 22, 3, 40, 3, 760469), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:40:04,186 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:40:04,264 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:40:04,267 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:40:04,269 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:40:05,281 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:40:05,415 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:40:05,622 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:40:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 03:40:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:35 UTC)" (scheduled at 2024-04-22 03:40:05.871852+00:00)
securityworker stdout | 2024-04-22 03:40:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:40:06,419 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:40:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:40:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:13.555667+00:00 (in 7.002719 seconds)
repositorygcworker stdout | 2024-04-22 03:40:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:06 UTC)" (scheduled at 2024-04-22 03:40:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:40:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:40:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 6, 553321), True, datetime.datetime(2024, 4, 22, 3, 40, 6, 553321), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:40:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:40:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:40:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:40:07,847 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:40:07,912 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:40:08,337 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:40:08,483 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:40:09,500 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:40:10,461 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:40:10,471 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:40:10,473 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:40:10,479 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:40:10,484 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:40:10,486 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:40:10,489 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:40:10,491 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:40:10,494 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:40:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:40:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:41.264267+00:00 (in 29.999490 seconds)
autopruneworker stdout | 2024-04-22 03:40:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:41 UTC)" (scheduled at 2024-04-22 03:40:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:40:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757151271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:40:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:40:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:40:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:40:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:06.552482+00:00 (in 52.996366 seconds)
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:13 UTC)" (scheduled at 2024-04-22 03:40:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:40:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:19.762424+00:00 (in 6.002615 seconds)
notificationworker stdout | 2024-04-22 03:40:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:23 UTC)" (scheduled at 2024-04-22 03:40:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 13, 760090), True, datetime.datetime(2024, 4, 22, 3, 40, 13, 760090), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:40:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:40:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:44.952062+00:00 (in 29.999483 seconds)
gcworker stdout | 2024-04-22 03:40:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:44 UTC)" (scheduled at 2024-04-22 03:40:14.952062+00:00)
gcworker stdout | 2024-04-22 03:40:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:40:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:40:15,653 [278] [DEBUG] [app] Starting request: urn:request:61db2a97-9e04-4e34-b5c7-00bc21284677 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:15,653 [282] [DEBUG] [app] Starting request: urn:request:4601a33c-2a33-43e9-b337-322c0c60863c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [284] [DEBUG] [app] Starting request: urn:request:34a0112f-50c5-47e4-8375-f553da6d950f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [292] [DEBUG] [app] Starting request: urn:request:ee2da710-f8d9-463d-903d-2dc16ce9a786 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [284] [DEBUG] [app] Ending request: urn:request:34a0112f-50c5-47e4-8375-f553da6d950f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:34a0112f-50c5-47e4-8375-f553da6d950f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [292] [DEBUG] [app] Ending request: urn:request:ee2da710-f8d9-463d-903d-2dc16ce9a786 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ee2da710-f8d9-463d-903d-2dc16ce9a786', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:40:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:15,659 [282] [DEBUG] [app] Starting request: urn:request:dc29004c-aeff-4edb-8796-70c4b7c5c499 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:15,659 [282] [DEBUG] [app] Ending request: urn:request:dc29004c-aeff-4edb-8796-70c4b7c5c499 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dc29004c-aeff-4edb-8796-70c4b7c5c499', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:15,659 [279] [DEBUG] [app] Starting request: urn:request:2c3864c5-6e21-4e4f-9ffb-e00a7607ae2d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:15,660 [279] [DEBUG] [app] Ending request: urn:request:2c3864c5-6e21-4e4f-9ffb-e00a7607ae2d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2c3864c5-6e21-4e4f-9ffb-e00a7607ae2d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:15,674 [278] [DEBUG] [app] Ending request: urn:request:61db2a97-9e04-4e34-b5c7-00bc21284677 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:61db2a97-9e04-4e34-b5c7-00bc21284677', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:15,674 [282] [DEBUG] [app] Ending request: urn:request:4601a33c-2a33-43e9-b337-322c0c60863c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4601a33c-2a33-43e9-b337-322c0c60863c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:40:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:02.556208+00:00 (in 46.003294 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:16 UTC)" (scheduled at 2024-04-22 03:40:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 16, 553296), True, datetime.datetime(2024, 4, 22, 3, 40, 16, 553296), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:40:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:40:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:47.052354+00:00 (in 29.999466 seconds)
buildlogsarchiver stdout | 2024-04-22 03:40:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:47 UTC)" (scheduled at 2024-04-22 03:40:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:40:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 40, 17, 53267), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:40:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:40:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:40:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:40:18,673 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:40:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:23.759375+00:00 (in 3.996430 seconds)
notificationworker stdout | 2024-04-22 03:40:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:19 UTC)" (scheduled at 2024-04-22 03:40:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:40:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:40:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:40:20,362 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:43.057186+00:00 (in 20.997722 seconds)
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:22 UTC)" (scheduled at 2024-04-22 03:40:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:40:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:33.759375+00:00 (in 9.999446 seconds)
notificationworker stdout | 2024-04-22 03:40:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:33 UTC)" (scheduled at 2024-04-22 03:40:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 23, 760396), True, datetime.datetime(2024, 4, 22, 3, 40, 23, 760396), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:40:23,815 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:24.361582+00:00 (in 59.999477 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:24 UTC)" (scheduled at 2024-04-22 03:40:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:40:25,418 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:40:26,839 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:35.871852+00:00 (in 8.998288 seconds)
securityworker stdout | 2024-04-22 03:40:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:56 UTC)" (scheduled at 2024-04-22 03:40:26.873109+00:00)
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:40:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:40:26,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:26,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:40:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 35, 26, 880387), 1, 2])
securityworker stdout | 2024-04-22 03:40:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 35, 26, 880387), 1, 2])
securityworker stdout | 2024-04-22 03:40:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:40:28,793 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:40:28,814 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:40:29,666 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:40:29,676 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:40:29,678 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:40:29,682 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:40:29,686 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:40:29,873 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:40:30,653 [278] [DEBUG] [app] Starting request: urn:request:8d7a26e2-4c58-4475-9c2e-05992336a7d1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:30,653 [282] [DEBUG] [app] Starting request: urn:request:dcc1dce7-889e-4762-988f-1c327b076c62 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:30,656 [291] [DEBUG] [app] Starting request: urn:request:f765916b-cf38-4d72-a9b6-225c190bcb7e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:30,656 [292] [DEBUG] [app] Starting request: urn:request:5a291ceb-4b27-4ff5-94b2-b0045ec8d08a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [292] [DEBUG] [app] Ending request: urn:request:5a291ceb-4b27-4ff5-94b2-b0045ec8d08a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5a291ceb-4b27-4ff5-94b2-b0045ec8d08a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [291] [DEBUG] [app] Ending request: urn:request:f765916b-cf38-4d72-a9b6-225c190bcb7e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f765916b-cf38-4d72-a9b6-225c190bcb7e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:30,660 [278] [DEBUG] [app] Starting request: urn:request:3e6a4022-cf4c-4887-938f-c7c1e2871c56 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [279] [DEBUG] [app] Starting request: urn:request:91371efb-9040-4ec4-93fe-bfc1d062327d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [278] [DEBUG] [app] Ending request: urn:request:3e6a4022-cf4c-4887-938f-c7c1e2871c56 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3e6a4022-cf4c-4887-938f-c7c1e2871c56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [279] [DEBUG] [app] Ending request: urn:request:91371efb-9040-4ec4-93fe-bfc1d062327d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:91371efb-9040-4ec4-93fe-bfc1d062327d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:30,674 [278] [DEBUG] [app] Ending request: urn:request:8d7a26e2-4c58-4475-9c2e-05992336a7d1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8d7a26e2-4c58-4475-9c2e-05992336a7d1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:40:30,678 [282] [DEBUG] [app] Ending request: urn:request:dcc1dce7-889e-4762-988f-1c327b076c62 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:dcc1dce7-889e-4762-988f-1c327b076c62', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:30,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:30,679 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
notificationworker stdout | 2024-04-22 03:40:31,280 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:40:32,664 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:40:32,985 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:40:33,070 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:40:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:43.759375+00:00 (in 9.999426 seconds)
notificationworker stdout | 2024-04-22 03:40:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:43 UTC)" (scheduled at 2024-04-22 03:40:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 33, 760225), True, datetime.datetime(2024, 4, 22, 3, 40, 33, 760225), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:40:34,214 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:40:34,272 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:40:34,274 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:40:34,277 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:40:35,317 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:40:35,443 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:40:35,658 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:56.873109+00:00 (in 21.000821 seconds)
securityworker stdout | 2024-04-22 03:40:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:05 UTC)" (scheduled at 2024-04-22 03:40:35.871852+00:00)
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:40:36,446 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:40:37,878 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:40:37,935 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:40:38,363 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:40:38,489 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:40:39,536 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:41.564959+00:00 (in 1.997481 seconds)
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:39 UTC)" (scheduled at 2024-04-22 03:40:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:40:40,471 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:40:40,480 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:40:40,482 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:40:40,490 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:40:40,493 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:40:40,496 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:40:40,499 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:40:40,501 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:40:40,505 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:40:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:40:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:11.264267+00:00 (in 29.999459 seconds)
autopruneworker stdout | 2024-04-22 03:40:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:11 UTC)" (scheduled at 2024-04-22 03:40:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:40:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757181271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:40:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:40:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:40:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:39.566970+00:00 (in 58.001464 seconds)
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:41 UTC)" (scheduled at 2024-04-22 03:40:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:40:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 41, 565838), True, datetime.datetime(2024, 4, 22, 3, 40, 41, 565838), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:40:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:40:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:40:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:22.058978+00:00 (in 39.001290 seconds)
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:43 UTC)" (scheduled at 2024-04-22 03:40:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:40:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 43, 58024), True, datetime.datetime(2024, 4, 22, 3, 40, 43, 58024), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:40:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:40:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:40:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:40:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:53.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:40:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:53 UTC)" (scheduled at 2024-04-22 03:40:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 43, 760347), True, datetime.datetime(2024, 4, 22, 3, 40, 43, 760347), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:40:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:40:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:14.952062+00:00 (in 29.999506 seconds)
gcworker stdout | 2024-04-22 03:40:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:14 UTC)" (scheduled at 2024-04-22 03:40:44.952062+00:00)
gcworker stdout | 2024-04-22 03:40:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:40:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:40:45,653 [281] [DEBUG] [app] Starting request: urn:request:484049e8-56e4-46e9-8d48-d096a18715ff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:45,653 [278] [DEBUG] [app] Starting request: urn:request:bb625eee-a914-4a8c-9c2b-ab395543cdd4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:45,656 [284] [DEBUG] [app] Starting request: urn:request:7f7bb892-38e0-4c9b-b998-a91bd704c9ef (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:45,656 [284] [DEBUG] [app] Ending request: urn:request:7f7bb892-38e0-4c9b-b998-a91bd704c9ef (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7f7bb892-38e0-4c9b-b998-a91bd704c9ef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [291] [DEBUG] [app] Starting request: urn:request:8d81c495-7fd5-4974-abb8-2454d4c5d40a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [291] [DEBUG] [app] Ending request: urn:request:8d81c495-7fd5-4974-abb8-2454d4c5d40a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8d81c495-7fd5-4974-abb8-2454d4c5d40a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:40:45,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:45,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:45,660 [279] [DEBUG] [app] Starting request: urn:request:928c8be9-a47c-4882-9d2b-92fb0bcf93d4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:45,660 [279] [DEBUG] [app] Ending request: urn:request:928c8be9-a47c-4882-9d2b-92fb0bcf93d4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:928c8be9-a47c-4882-9d2b-92fb0bcf93d4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:40:45,661 [278] [DEBUG] [app] Starting request: urn:request:d6e97484-a35c-4a67-bda5-c6a9d13da125 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:45,661 [278] [DEBUG] [app] Ending request: urn:request:d6e97484-a35c-4a67-bda5-c6a9d13da125 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d6e97484-a35c-4a67-bda5-c6a9d13da125', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:40:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:45,676 [278] [DEBUG] [app] Ending request: urn:request:bb625eee-a914-4a8c-9c2b-ab395543cdd4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bb625eee-a914-4a8c-9c2b-ab395543cdd4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:40:45,677 [281] [DEBUG] [app] Ending request: urn:request:484049e8-56e4-46e9-8d48-d096a18715ff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:484049e8-56e4-46e9-8d48-d096a18715ff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:45,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:45,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:40:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:40:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:17.052354+00:00 (in 29.999524 seconds)
buildlogsarchiver stdout | 2024-04-22 03:40:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:17 UTC)" (scheduled at 2024-04-22 03:40:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:40:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 40, 47, 53160), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:40:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:40:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:40:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:40:48,711 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:40:50,378 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:40:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:03.759375+00:00 (in 9.999463 seconds)
notificationworker stdout | 2024-04-22 03:40:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:03 UTC)" (scheduled at 2024-04-22 03:40:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 53, 760205), True, datetime.datetime(2024, 4, 22, 3, 40, 53, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:40:53,852 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:40:55,433 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:40:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:05.871852+00:00 (in 8.998287 seconds)
securityworker stdout | 2024-04-22 03:40:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:26 UTC)" (scheduled at 2024-04-22 03:40:56.873109+00:00)
securityworker stdout | 2024-04-22 03:40:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
repositorygcworker stdout | 2024-04-22 03:40:56,876 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:40:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:40:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:40:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 35, 56, 880609), 1, 2])
securityworker stdout | 2024-04-22 03:40:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:56,900 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 35, 56, 880609), 1, 2])
securityworker stdout | 2024-04-22 03:40:56,902 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:56,902 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:56,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:56,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:40:58,800 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:40:58,823 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:40:59,674 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:40:59,684 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:40:59,686 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:40:59,690 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:40:59,693 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:40:59,889 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:41:00,653 [282] [DEBUG] [app] Starting request: urn:request:02fdfead-33e1-4a9b-ab39-1d788216f540 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:00,653 [281] [DEBUG] [app] Starting request: urn:request:3291090b-c453-4bfd-9594-2e0097a1af2a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [284] [DEBUG] [app] Starting request: urn:request:61d1bb34-a10d-46a5-8151-3c249c0367ea (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [291] [DEBUG] [app] Starting request: urn:request:f6b0e04c-76db-4f5e-b2f6-5e37d43850f7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [284] [DEBUG] [app] Ending request: urn:request:61d1bb34-a10d-46a5-8151-3c249c0367ea (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61d1bb34-a10d-46a5-8151-3c249c0367ea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [291] [DEBUG] [app] Ending request: urn:request:f6b0e04c-76db-4f5e-b2f6-5e37d43850f7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f6b0e04c-76db-4f5e-b2f6-5e37d43850f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 03:41:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:00,659 [278] [DEBUG] [app] Starting request: urn:request:f71821c1-a45f-4a1a-983f-cd5dcb46e4fb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:00,660 [278] [DEBUG] [app] Ending request: urn:request:f71821c1-a45f-4a1a-983f-cd5dcb46e4fb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f71821c1-a45f-4a1a-983f-cd5dcb46e4fb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:00,660 [282] [DEBUG] [app] Starting request: urn:request:2ccfc660-915a-48fd-a8e3-e10072ff8d0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:00,660 [282] [DEBUG] [app] Ending request: urn:request:2ccfc660-915a-48fd-a8e3-e10072ff8d0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2ccfc660-915a-48fd-a8e3-e10072ff8d0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:00,675 [281] [DEBUG] [app] Ending request: urn:request:3291090b-c453-4bfd-9594-2e0097a1af2a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3291090b-c453-4bfd-9594-2e0097a1af2a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:00,676 [282] [DEBUG] [app] Ending request: urn:request:02fdfead-33e1-4a9b-ab39-1d788216f540 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:02fdfead-33e1-4a9b-ab39-1d788216f540', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:41:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:41:01,297 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:16.552337+00:00 (in 13.995678 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:02 UTC)" (scheduled at 2024-04-22 03:41:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:41:02,671 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:41:02,995 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:41:03,107 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:41:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 03:41:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:13 UTC)" (scheduled at 2024-04-22 03:41:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 3, 760425), True, datetime.datetime(2024, 4, 22, 3, 41, 3, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:41:04,251 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:41:04,278 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:41:04,282 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:41:04,285 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:41:05,350 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:41:05,453 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:41:05,665 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:26.873109+00:00 (in 21.000759 seconds)
securityworker stdout | 2024-04-22 03:41:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:35 UTC)" (scheduled at 2024-04-22 03:41:05.871852+00:00)
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:41:06,456 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:41:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:41:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:13.555667+00:00 (in 7.002752 seconds)
repositorygcworker stdout | 2024-04-22 03:41:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:06 UTC)" (scheduled at 2024-04-22 03:41:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:41:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:41:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 6, 553269), True, datetime.datetime(2024, 4, 22, 3, 41, 6, 553269), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:41:06,568 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:41:06,568 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:41:06,568 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:41:07,888 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:41:07,956 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:41:08,381 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:41:08,496 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:41:09,566 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:41:10,480 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:41:10,489 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:41:10,493 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:41:10,499 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:41:10,503 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:41:10,506 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:41:10,511 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:41:10,515 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:41:10,519 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:41:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:41:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:41.264267+00:00 (in 29.999511 seconds)
autopruneworker stdout | 2024-04-22 03:41:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:41 UTC)" (scheduled at 2024-04-22 03:41:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:41:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757211271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:41:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:41:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:41:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:41:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:51.555445+00:00 (in 37.999316 seconds)
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:13 UTC)" (scheduled at 2024-04-22 03:41:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:19.762424+00:00 (in 6.002574 seconds)
notificationworker stdout | 2024-04-22 03:41:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:23 UTC)" (scheduled at 2024-04-22 03:41:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 13, 760103), True, datetime.datetime(2024, 4, 22, 3, 41, 13, 760103), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:41:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:41:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:44.952062+00:00 (in 29.999507 seconds)
gcworker stdout | 2024-04-22 03:41:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:44 UTC)" (scheduled at 2024-04-22 03:41:14.952062+00:00)
gcworker stdout | 2024-04-22 03:41:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:41:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:41:15,653 [278] [DEBUG] [app] Starting request: urn:request:6dfdacd0-5ee0-4c5d-a7e9-a7bbc89324ce (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:15,653 [281] [DEBUG] [app] Starting request: urn:request:6ef781a3-c917-4399-b63c-49491c7a8e8b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:15,656 [291] [DEBUG] [app] Starting request: urn:request:bcdcc2d8-aff1-4c75-abc5-4ad24819bf25 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:15,656 [285] [DEBUG] [app] Starting request: urn:request:d1825a50-4cad-4693-928d-dcaa593ed938 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [291] [DEBUG] [app] Ending request: urn:request:bcdcc2d8-aff1-4c75-abc5-4ad24819bf25 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bcdcc2d8-aff1-4c75-abc5-4ad24819bf25', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [285] [DEBUG] [app] Ending request: urn:request:d1825a50-4cad-4693-928d-dcaa593ed938 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d1825a50-4cad-4693-928d-dcaa593ed938', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:41:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:15,660 [279] [DEBUG] [app] Starting request: urn:request:819f8418-94ae-4c60-963c-3b5f41b21622 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:15,660 [279] [DEBUG] [app] Ending request: urn:request:819f8418-94ae-4c60-963c-3b5f41b21622 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:819f8418-94ae-4c60-963c-3b5f41b21622', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:15,661 [282] [DEBUG] [app] Starting request: urn:request:33c1b634-b3bf-4176-9d86-6c01866ee416 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:15,661 [282] [DEBUG] [app] Ending request: urn:request:33c1b634-b3bf-4176-9d86-6c01866ee416 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:33c1b634-b3bf-4176-9d86-6c01866ee416', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:15,675 [281] [DEBUG] [app] Ending request: urn:request:6ef781a3-c917-4399-b63c-49491c7a8e8b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6ef781a3-c917-4399-b63c-49491c7a8e8b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:41:15,675 [278] [DEBUG] [app] Ending request: urn:request:6dfdacd0-5ee0-4c5d-a7e9-a7bbc89324ce (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6dfdacd0-5ee0-4c5d-a7e9-a7bbc89324ce', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:41:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:02.556208+00:00 (in 46.003343 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:16 UTC)" (scheduled at 2024-04-22 03:41:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 16, 553339), True, datetime.datetime(2024, 4, 22, 3, 41, 16, 553339), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:41:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:41:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:47.052354+00:00 (in 29.999394 seconds)
buildlogsarchiver stdout | 2024-04-22 03:41:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:47 UTC)" (scheduled at 2024-04-22 03:41:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:41:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 41, 17, 53397), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:41:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:41:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:41:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:41:18,747 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:41:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:23.759375+00:00 (in 3.996384 seconds)
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:19 UTC)" (scheduled at 2024-04-22 03:41:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:41:20,415 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:43.057186+00:00 (in 20.997676 seconds)
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:22 UTC)" (scheduled at 2024-04-22 03:41:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:33.759375+00:00 (in 9.999448 seconds)
notificationworker stdout | 2024-04-22 03:41:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:33 UTC)" (scheduled at 2024-04-22 03:41:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 23, 760401), True, datetime.datetime(2024, 4, 22, 3, 41, 23, 760401), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:23,773 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:23,773 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:23,773 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:41:23,887 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:24.361582+00:00 (in 59.999529 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:24 UTC)" (scheduled at 2024-04-22 03:41:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:41:25,456 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:41:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:35.871852+00:00 (in 8.998221 seconds)
securityworker stdout | 2024-04-22 03:41:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:56 UTC)" (scheduled at 2024-04-22 03:41:26.873109+00:00)
securityworker stdout | 2024-04-22 03:41:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:41:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:41:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 36, 26, 881160), 1, 2])
securityworker stdout | 2024-04-22 03:41:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 36, 26, 881160), 1, 2])
securityworker stdout | 2024-04-22 03:41:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:41:26,904 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
chunkcleanupworker stdout | 2024-04-22 03:41:28,837 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:41:28,859 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:41:29,682 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:41:29,691 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:41:29,693 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:41:29,697 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:41:29,699 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:41:29,925 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:41:30,653 [282] [DEBUG] [app] Starting request: urn:request:7e94fdd8-d0d1-4ab7-8511-0fa265476065 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:30,653 [281] [DEBUG] [app] Starting request: urn:request:a096df9a-8135-41ee-9f3c-cf66ce49e5ab (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [292] [DEBUG] [app] Starting request: urn:request:bef83bda-8910-4831-89fa-a8742ad2d7d2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [284] [DEBUG] [app] Starting request: urn:request:dedb1c4b-b7a9-4b56-a946-23a5acc89c28 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [292] [DEBUG] [app] Ending request: urn:request:bef83bda-8910-4831-89fa-a8742ad2d7d2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bef83bda-8910-4831-89fa-a8742ad2d7d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [284] [DEBUG] [app] Ending request: urn:request:dedb1c4b-b7a9-4b56-a946-23a5acc89c28 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:dedb1c4b-b7a9-4b56-a946-23a5acc89c28', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:41:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:30,659 [282] [DEBUG] [app] Starting request: urn:request:5992da2b-e2b6-41b3-b7c1-63109263f777 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:30,659 [282] [DEBUG] [app] Ending request: urn:request:5992da2b-e2b6-41b3-b7c1-63109263f777 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5992da2b-e2b6-41b3-b7c1-63109263f777', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:30,659 [278] [DEBUG] [app] Starting request: urn:request:6f3a98e0-cbc7-4000-a944-9b41ebb11062 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:30,660 [278] [DEBUG] [app] Ending request: urn:request:6f3a98e0-cbc7-4000-a944-9b41ebb11062 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6f3a98e0-cbc7-4000-a944-9b41ebb11062', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:30,674 [281] [DEBUG] [app] Ending request: urn:request:a096df9a-8135-41ee-9f3c-cf66ce49e5ab (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a096df9a-8135-41ee-9f3c-cf66ce49e5ab', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:30,674 [282] [DEBUG] [app] Ending request: urn:request:7e94fdd8-d0d1-4ab7-8511-0fa265476065 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7e94fdd8-d0d1-4ab7-8511-0fa265476065', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:41:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:41:31,333 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:41:32,707 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:41:33,020 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:41:33,119 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:41:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:43.759375+00:00 (in 9.999436 seconds)
notificationworker stdout | 2024-04-22 03:41:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:43 UTC)" (scheduled at 2024-04-22 03:41:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 33, 760229), True, datetime.datetime(2024, 4, 22, 3, 41, 33, 760229), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:41:34,258 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:41:34,284 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:41:34,289 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:41:34,291 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:41:35,377 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:41:35,469 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:41:35,701 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:56.873109+00:00 (in 21.000830 seconds)
securityworker stdout | 2024-04-22 03:41:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:05 UTC)" (scheduled at 2024-04-22 03:41:35.871852+00:00)
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:41:36,486 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:41:37,925 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:41:37,962 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:41:38,419 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:41:38,505 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:41.564959+00:00 (in 1.997454 seconds)
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:39 UTC)" (scheduled at 2024-04-22 03:41:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:41:39,603 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:41:40,489 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:41:40,502 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:41:40,505 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:41:40,507 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:41:40,511 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:41:40,514 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:41:40,519 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:41:40,524 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:41:40,530 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:41:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:41:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:11.264267+00:00 (in 29.999411 seconds)
autopruneworker stdout | 2024-04-22 03:41:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:11 UTC)" (scheduled at 2024-04-22 03:41:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:41:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757241272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:41:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:41:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:41:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:53.566665+00:00 (in 12.001265 seconds)
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:41 UTC)" (scheduled at 2024-04-22 03:41:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:41:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 41, 565635), True, datetime.datetime(2024, 4, 22, 3, 41, 41, 565635), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:41:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:41:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:41:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:41:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:41:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:22.058978+00:00 (in 39.001300 seconds)
namespacegcworker stdout | 2024-04-22 03:41:43,058 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:43 UTC)" (scheduled at 2024-04-22 03:41:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:41:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:41:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 43, 58273), True, datetime.datetime(2024, 4, 22, 3, 41, 43, 58273), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:41:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:41:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:41:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:53.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 03:41:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:53 UTC)" (scheduled at 2024-04-22 03:41:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 43, 760172), True, datetime.datetime(2024, 4, 22, 3, 41, 43, 760172), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:41:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:41:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:14.952062+00:00 (in 29.999469 seconds)
gcworker stdout | 2024-04-22 03:41:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:14 UTC)" (scheduled at 2024-04-22 03:41:44.952062+00:00)
gcworker stdout | 2024-04-22 03:41:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:41:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:41:45,653 [281] [DEBUG] [app] Starting request: urn:request:b2fc70fe-a288-497e-9dc7-b91e746f867c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:45,653 [282] [DEBUG] [app] Starting request: urn:request:a1c83423-d484-4846-873d-d3c4ec8e8116 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [285] [DEBUG] [app] Starting request: urn:request:4b1d6291-fecc-45b3-ab6a-31e52ff0d700 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [291] [DEBUG] [app] Starting request: urn:request:a691e516-47a0-48ad-9be1-5c886953cbe8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [285] [DEBUG] [app] Ending request: urn:request:4b1d6291-fecc-45b3-ab6a-31e52ff0d700 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4b1d6291-fecc-45b3-ab6a-31e52ff0d700', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [291] [DEBUG] [app] Ending request: urn:request:a691e516-47a0-48ad-9be1-5c886953cbe8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a691e516-47a0-48ad-9be1-5c886953cbe8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:45,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:41:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:45,659 [282] [DEBUG] [app] Starting request: urn:request:81dc4e33-a467-4cd1-8627-2451bb848c56 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:45,660 [282] [DEBUG] [app] Ending request: urn:request:81dc4e33-a467-4cd1-8627-2451bb848c56 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:81dc4e33-a467-4cd1-8627-2451bb848c56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,661 [278] [DEBUG] [app] Starting request: urn:request:74936a76-3f1e-417b-a6d5-1b9e44390e36 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:45,661 [278] [DEBUG] [app] Ending request: urn:request:74936a76-3f1e-417b-a6d5-1b9e44390e36 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:74936a76-3f1e-417b-a6d5-1b9e44390e36', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:45,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:45,675 [282] [DEBUG] [app] Ending request: urn:request:a1c83423-d484-4846-873d-d3c4ec8e8116 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1c83423-d484-4846-873d-d3c4ec8e8116', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:41:45,676 [281] [DEBUG] [app] Ending request: urn:request:b2fc70fe-a288-497e-9dc7-b91e746f867c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b2fc70fe-a288-497e-9dc7-b91e746f867c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:45,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:45,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
buildlogsarchiver stdout | 2024-04-22 03:41:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:41:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:17.052354+00:00 (in 29.999468 seconds)
buildlogsarchiver stdout | 2024-04-22 03:41:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:17 UTC)" (scheduled at 2024-04-22 03:41:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:41:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 41, 47, 53214), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:41:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:41:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:41:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:41:48,785 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:41:50,451 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:41:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:41:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:06.552482+00:00 (in 14.996483 seconds)
repositorygcworker stdout | 2024-04-22 03:41:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:51 UTC)" (scheduled at 2024-04-22 03:41:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:41:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:41:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), True, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:41:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), True, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:41:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:41:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:41:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:41:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:39.566970+00:00 (in 45.999812 seconds)
exportactionlogsworker stdout | 2024-04-22 03:41:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:53 UTC)" (scheduled at 2024-04-22 03:41:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:41:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:41:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), True, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:41:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), True, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:41:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:41:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:03.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:41:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:03 UTC)" (scheduled at 2024-04-22 03:41:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 53, 760219), True, datetime.datetime(2024, 4, 22, 3, 41, 53, 760219), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:41:53,915 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:41:55,492 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:41:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:05.871852+00:00 (in 8.998248 seconds)
securityworker stdout | 2024-04-22 03:41:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:26 UTC)" (scheduled at 2024-04-22 03:41:56.873109+00:00)
securityworker stdout | 2024-04-22 03:41:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:41:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:41:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:41:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 36, 56, 880635), 1, 2])
securityworker stdout | 2024-04-22 03:41:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 36, 56, 880635), 1, 2])
securityworker stdout | 2024-04-22 03:41:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:41:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:41:56,940 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:41:58,867 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:41:58,870 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:41:59,689 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:41:59,699 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:41:59,702 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:41:59,705 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:41:59,707 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:41:59,933 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:42:00,653 [281] [DEBUG] [app] Starting request: urn:request:0d5d54f7-2abb-45eb-80e9-a3439018d7ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:00,653 [278] [DEBUG] [app] Starting request: urn:request:ecad7209-966a-473c-b357-aea03f6b7584 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:00,656 [291] [DEBUG] [app] Starting request: urn:request:cf847bad-bc49-4a58-960b-4e7cb64e7048 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [291] [DEBUG] [app] Ending request: urn:request:cf847bad-bc49-4a58-960b-4e7cb64e7048 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf847bad-bc49-4a58-960b-4e7cb64e7048', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [292] [DEBUG] [app] Starting request: urn:request:0c2bee4b-bd99-4c76-8f14-8d820152db53 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [292] [DEBUG] [app] Ending request: urn:request:0c2bee4b-bd99-4c76-8f14-8d820152db53 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0c2bee4b-bd99-4c76-8f14-8d820152db53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:42:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:00,660 [279] [DEBUG] [app] Starting request: urn:request:2da88cb4-db05-4c98-975b-ce03cefe7154 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:00,660 [279] [DEBUG] [app] Ending request: urn:request:2da88cb4-db05-4c98-975b-ce03cefe7154 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2da88cb4-db05-4c98-975b-ce03cefe7154', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:42:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:00,661 [282] [DEBUG] [app] Starting request: urn:request:3b703a39-7db9-4252-8676-38a2f77200a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:00,661 [282] [DEBUG] [app] Ending request: urn:request:3b703a39-7db9-4252-8676-38a2f77200a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3b703a39-7db9-4252-8676-38a2f77200a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:42:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:00,675 [281] [DEBUG] [app] Ending request: urn:request:0d5d54f7-2abb-45eb-80e9-a3439018d7ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0d5d54f7-2abb-45eb-80e9-a3439018d7ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:00,676 [278] [DEBUG] [app] Ending request: urn:request:ecad7209-966a-473c-b357-aea03f6b7584 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ecad7209-966a-473c-b357-aea03f6b7584', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:42:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
notificationworker stdout | 2024-04-22 03:42:01,340 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:16.552337+00:00 (in 13.995671 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:02 UTC)" (scheduled at 2024-04-22 03:42:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:42:02,713 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:42:03,026 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:42:03,129 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:42:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:13.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 03:42:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:13 UTC)" (scheduled at 2024-04-22 03:42:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 3, 760332), True, datetime.datetime(2024, 4, 22, 3, 42, 3, 760332), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:42:04,294 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
logrotateworker stdout | 2024-04-22 03:42:04,297 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:42:04,300 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:42:04,302 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:42:05,383 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:42:05,505 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:42:05,738 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 03:42:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:35 UTC)" (scheduled at 2024-04-22 03:42:05.871852+00:00)
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:42:06,520 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:42:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:42:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:13.555667+00:00 (in 7.002679 seconds)
repositorygcworker stdout | 2024-04-22 03:42:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:06 UTC)" (scheduled at 2024-04-22 03:42:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:42:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:42:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 6, 553382), True, datetime.datetime(2024, 4, 22, 3, 42, 6, 553382), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:42:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:42:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:42:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:42:07,952 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:42:07,996 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:42:08,430 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:42:08,541 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:42:09,615 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:42:10,498 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:42:10,510 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:42:10,513 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:42:10,517 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:42:10,521 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:42:10,523 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:42:10,526 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:42:10,535 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:42:10,538 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:42:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:42:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:41.264267+00:00 (in 29.999522 seconds)
autopruneworker stdout | 2024-04-22 03:42:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:41 UTC)" (scheduled at 2024-04-22 03:42:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:42:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757271271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:42:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:42:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:42:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:42:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:06.552482+00:00 (in 52.996320 seconds)
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:13 UTC)" (scheduled at 2024-04-22 03:42:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:42:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:19.762424+00:00 (in 6.002491 seconds)
notificationworker stdout | 2024-04-22 03:42:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:23 UTC)" (scheduled at 2024-04-22 03:42:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 13, 760255), True, datetime.datetime(2024, 4, 22, 3, 42, 13, 760255), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:42:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:42:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:44.952062+00:00 (in 29.999543 seconds)
gcworker stdout | 2024-04-22 03:42:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:44 UTC)" (scheduled at 2024-04-22 03:42:14.952062+00:00)
gcworker stdout | 2024-04-22 03:42:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:42:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:42:15,653 [278] [DEBUG] [app] Starting request: urn:request:84a6f032-9312-49e0-ab74-3edc56c13f00 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:15,653 [282] [DEBUG] [app] Starting request: urn:request:bbc0332d-e694-448d-9f10-086b2a42f5fb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [291] [DEBUG] [app] Starting request: urn:request:f1f46b5c-bc50-4b31-8528-0de3afdb778b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [289] [DEBUG] [app] Starting request: urn:request:43f6cc7c-dab7-4cad-ae80-2d58649872e2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [291] [DEBUG] [app] Ending request: urn:request:f1f46b5c-bc50-4b31-8528-0de3afdb778b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f1f46b5c-bc50-4b31-8528-0de3afdb778b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [289] [DEBUG] [app] Ending request: urn:request:43f6cc7c-dab7-4cad-ae80-2d58649872e2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43f6cc7c-dab7-4cad-ae80-2d58649872e2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:15,659 [282] [DEBUG] [app] Starting request: urn:request:f3e46124-30bf-4ce2-b3fe-308eaa2b309d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:15,659 [282] [DEBUG] [app] Ending request: urn:request:f3e46124-30bf-4ce2-b3fe-308eaa2b309d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f3e46124-30bf-4ce2-b3fe-308eaa2b309d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:15,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:15,659 [281] [DEBUG] [app] Starting request: urn:request:a004fc4f-4c01-4579-b69b-67ec9ff0f435 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:15,660 [281] [DEBUG] [app] Ending request: urn:request:a004fc4f-4c01-4579-b69b-67ec9ff0f435 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a004fc4f-4c01-4579-b69b-67ec9ff0f435', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:15,674 [282] [DEBUG] [app] Ending request: urn:request:bbc0332d-e694-448d-9f10-086b2a42f5fb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bbc0332d-e694-448d-9f10-086b2a42f5fb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:15,674 [278] [DEBUG] [app] Ending request: urn:request:84a6f032-9312-49e0-ab74-3edc56c13f00 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:84a6f032-9312-49e0-ab74-3edc56c13f00', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:42:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:21.555879+00:00 (in 5.003003 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:16 UTC)" (scheduled at 2024-04-22 03:42:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 16, 553290), True, datetime.datetime(2024, 4, 22, 3, 42, 16, 553290), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:42:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:42:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:47.052354+00:00 (in 29.999528 seconds)
buildlogsarchiver stdout | 2024-04-22 03:42:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:47 UTC)" (scheduled at 2024-04-22 03:42:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:42:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 42, 17, 53178), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:42:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:42:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:42:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:42:18,822 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:42:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:23.759375+00:00 (in 3.996355 seconds)
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:19 UTC)" (scheduled at 2024-04-22 03:42:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:42:20,464 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:02.556208+00:00 (in 40.999809 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:21 UTC)" (scheduled at 2024-04-22 03:42:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), True, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), True, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:38.058708+00:00 (in 15.999239 seconds)
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:22 UTC)" (scheduled at 2024-04-22 03:42:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:42:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:33.759375+00:00 (in 9.999400 seconds)
notificationworker stdout | 2024-04-22 03:42:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:33 UTC)" (scheduled at 2024-04-22 03:42:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 23, 760424), True, datetime.datetime(2024, 4, 22, 3, 42, 23, 760424), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:42:23,924 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:24.361582+00:00 (in 59.999536 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:24 UTC)" (scheduled at 2024-04-22 03:42:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:42:25,527 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:42:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:35.871852+00:00 (in 8.998274 seconds)
securityworker stdout | 2024-04-22 03:42:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:56 UTC)" (scheduled at 2024-04-22 03:42:26.873109+00:00)
securityworker stdout | 2024-04-22 03:42:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:42:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:42:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:42:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 37, 26, 880729), 1, 2])
securityworker stdout | 2024-04-22 03:42:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 37, 26, 880729), 1, 2])
securityworker stdout | 2024-04-22 03:42:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:42:26,955 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:42:28,903 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:42:28,905 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:42:29,696 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:42:29,708 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:42:29,710 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:42:29,713 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:42:29,715 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:42:29,950 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:42:30,653 [278] [DEBUG] [app] Starting request: urn:request:6f98adbe-8f90-4376-acca-4de15fa82f66 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:30,653 [281] [DEBUG] [app] Starting request: urn:request:e4ffb7bf-b3d2-4632-8976-e67960c01e59 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [284] [DEBUG] [app] Starting request: urn:request:1c3ed706-c3d9-4ed6-87bb-d399d495b91c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [291] [DEBUG] [app] Starting request: urn:request:2adcad93-4c72-4ed5-b3da-d60dd512b91b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [284] [DEBUG] [app] Ending request: urn:request:1c3ed706-c3d9-4ed6-87bb-d399d495b91c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1c3ed706-c3d9-4ed6-87bb-d399d495b91c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [291] [DEBUG] [app] Ending request: urn:request:2adcad93-4c72-4ed5-b3da-d60dd512b91b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2adcad93-4c72-4ed5-b3da-d60dd512b91b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:42:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:30,659 [278] [DEBUG] [app] Starting request: urn:request:dd48c958-e88c-4493-9c46-9af4403d4b5e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:30,659 [278] [DEBUG] [app] Ending request: urn:request:dd48c958-e88c-4493-9c46-9af4403d4b5e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dd48c958-e88c-4493-9c46-9af4403d4b5e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:30,659 [282] [DEBUG] [app] Starting request: urn:request:22414020-d89d-4358-a97b-258b874af754 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:30,660 [282] [DEBUG] [app] Ending request: urn:request:22414020-d89d-4358-a97b-258b874af754 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:22414020-d89d-4358-a97b-258b874af754', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:30,674 [278] [DEBUG] [app] Ending request: urn:request:6f98adbe-8f90-4376-acca-4de15fa82f66 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6f98adbe-8f90-4376-acca-4de15fa82f66', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:42:30,674 [281] [DEBUG] [app] Ending request: urn:request:e4ffb7bf-b3d2-4632-8976-e67960c01e59 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e4ffb7bf-b3d2-4632-8976-e67960c01e59', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:42:31,377 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:42:32,735 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:42:33,041 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:42:33,136 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:42:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:43.759375+00:00 (in 9.999456 seconds)
notificationworker stdout | 2024-04-22 03:42:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:43 UTC)" (scheduled at 2024-04-22 03:42:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 33, 760243), True, datetime.datetime(2024, 4, 22, 3, 42, 33, 760243), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:42:34,303 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
logrotateworker stdout | 2024-04-22 03:42:34,305 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:42:34,308 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:42:34,310 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:42:35,400 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:42:35,541 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:42:35,775 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:56.873109+00:00 (in 21.000770 seconds)
securityworker stdout | 2024-04-22 03:42:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:05 UTC)" (scheduled at 2024-04-22 03:42:35.871852+00:00)
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:42:36,555 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:42:37,976 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:42:38,032 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:42:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:42:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:43.057186+00:00 (in 4.997953 seconds)
namespacegcworker stdout | 2024-04-22 03:42:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:38 UTC)" (scheduled at 2024-04-22 03:42:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:42:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:42:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), True, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:42:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), True, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:42:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:42:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:38 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 03:42:38,466 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:42:38,576 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:41.564959+00:00 (in 1.997456 seconds)
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:39 UTC)" (scheduled at 2024-04-22 03:42:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:42:39,648 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:42:40,510 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:42:40,520 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:42:40,523 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:42:40,525 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:42:40,529 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:42:40,532 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:42:40,534 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:42:40,544 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:42:40,548 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:42:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:42:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 03:42:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:11 UTC)" (scheduled at 2024-04-22 03:42:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:42:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757301272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:42:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:42:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:42:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:39.566970+00:00 (in 58.001475 seconds)
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:41 UTC)" (scheduled at 2024-04-22 03:42:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:42:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 41, 565841), True, datetime.datetime(2024, 4, 22, 3, 42, 41, 565841), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:42:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:42:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:42:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:22.058978+00:00 (in 39.001305 seconds)
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:43 UTC)" (scheduled at 2024-04-22 03:42:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:42:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 43, 57959), True, datetime.datetime(2024, 4, 22, 3, 42, 43, 57959), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:42:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:42:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:42:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:42:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:53.759375+00:00 (in 9.999430 seconds)
notificationworker stdout | 2024-04-22 03:42:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:53 UTC)" (scheduled at 2024-04-22 03:42:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 43, 760238), True, datetime.datetime(2024, 4, 22, 3, 42, 43, 760238), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:42:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:42:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:14.952062+00:00 (in 29.999560 seconds)
gcworker stdout | 2024-04-22 03:42:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:14 UTC)" (scheduled at 2024-04-22 03:42:44.952062+00:00)
gcworker stdout | 2024-04-22 03:42:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:42:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:42:45,652 [278] [DEBUG] [app] Starting request: urn:request:09a752f9-7feb-48cc-94f0-fdbda99a3222 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:45,652 [281] [DEBUG] [app] Starting request: urn:request:52485109-f84f-4c1a-b202-b88ceab7ed22 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [290] [DEBUG] [app] Starting request: urn:request:80cea62d-facd-40d7-b2eb-830227327b4e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [286] [DEBUG] [app] Starting request: urn:request:5d8235ad-aae1-45eb-a519-e32363a6ebc1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [286] [DEBUG] [app] Ending request: urn:request:5d8235ad-aae1-45eb-a519-e32363a6ebc1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5d8235ad-aae1-45eb-a519-e32363a6ebc1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [290] [DEBUG] [app] Ending request: urn:request:80cea62d-facd-40d7-b2eb-830227327b4e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:80cea62d-facd-40d7-b2eb-830227327b4e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:42:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:45,659 [282] [DEBUG] [app] Starting request: urn:request:9da1b29b-1b76-4142-bc0a-c66e1fbf7f05 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:45,659 [282] [DEBUG] [app] Ending request: urn:request:9da1b29b-1b76-4142-bc0a-c66e1fbf7f05 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9da1b29b-1b76-4142-bc0a-c66e1fbf7f05', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:42:45,660 [279] [DEBUG] [app] Starting request: urn:request:2f620a65-d86d-4b2a-989e-772a86511dd6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:45,660 [279] [DEBUG] [app] Ending request: urn:request:2f620a65-d86d-4b2a-989e-772a86511dd6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2f620a65-d86d-4b2a-989e-772a86511dd6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:45,674 [278] [DEBUG] [app] Ending request: urn:request:09a752f9-7feb-48cc-94f0-fdbda99a3222 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:09a752f9-7feb-48cc-94f0-fdbda99a3222', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:45,674 [281] [DEBUG] [app] Ending request: urn:request:52485109-f84f-4c1a-b202-b88ceab7ed22 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:52485109-f84f-4c1a-b202-b88ceab7ed22', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:42:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:42:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:42:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:42:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:17.052354+00:00 (in 29.999485 seconds)
buildlogsarchiver stdout | 2024-04-22 03:42:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:17 UTC)" (scheduled at 2024-04-22 03:42:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:42:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 42, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:42:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:42:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:42:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:42:48,859 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:42:50,480 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:42:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:03.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 03:42:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:03 UTC)" (scheduled at 2024-04-22 03:42:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 53, 760280), True, datetime.datetime(2024, 4, 22, 3, 42, 53, 760280), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:42:53,960 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:42:55,534 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:42:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:05.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 03:42:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:26 UTC)" (scheduled at 2024-04-22 03:42:56.873109+00:00)
securityworker stdout | 2024-04-22 03:42:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:42:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:42:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:42:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 37, 56, 881419), 1, 2])
securityworker stdout | 2024-04-22 03:42:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 37, 56, 881419), 1, 2])
securityworker stdout | 2024-04-22 03:42:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:42:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:42:56,991 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:42:58,939 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:42:58,941 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:42:59,704 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:42:59,713 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:42:59,719 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:42:59,721 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:42:59,724 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:42:59,962 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:43:00,653 [282] [DEBUG] [app] Starting request: urn:request:5f7b7390-2666-4e0d-9080-fb7e1465cce8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:00,653 [281] [DEBUG] [app] Starting request: urn:request:150b8669-b1e7-42c6-9c3d-3bd8f718331d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [289] [DEBUG] [app] Starting request: urn:request:f984003f-725e-4185-a4af-0c20a06688f9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [291] [DEBUG] [app] Starting request: urn:request:5c174044-a69f-4e08-9275-40dbf2daba76 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [289] [DEBUG] [app] Ending request: urn:request:f984003f-725e-4185-a4af-0c20a06688f9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f984003f-725e-4185-a4af-0c20a06688f9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [291] [DEBUG] [app] Ending request: urn:request:5c174044-a69f-4e08-9275-40dbf2daba76 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c174044-a69f-4e08-9275-40dbf2daba76', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:43:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:43:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:00,660 [278] [DEBUG] [app] Starting request: urn:request:e1d8c5d3-56df-4610-9bfb-135e0698c6b8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:00,660 [279] [DEBUG] [app] Starting request: urn:request:b09ed606-8ed7-4c86-bc4f-e8175d9e3920 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:00,660 [278] [DEBUG] [app] Ending request: urn:request:e1d8c5d3-56df-4610-9bfb-135e0698c6b8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e1d8c5d3-56df-4610-9bfb-135e0698c6b8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:00,660 [279] [DEBUG] [app] Ending request: urn:request:b09ed606-8ed7-4c86-bc4f-e8175d9e3920 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b09ed606-8ed7-4c86-bc4f-e8175d9e3920', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:43:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:00,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:00,676 [282] [DEBUG] [app] Ending request: urn:request:5f7b7390-2666-4e0d-9080-fb7e1465cce8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5f7b7390-2666-4e0d-9080-fb7e1465cce8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:00,676 [281] [DEBUG] [app] Ending request: urn:request:150b8669-b1e7-42c6-9c3d-3bd8f718331d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:150b8669-b1e7-42c6-9c3d-3bd8f718331d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:00,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:43:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:43:01,410 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:16.552337+00:00 (in 13.995603 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:02 UTC)" (scheduled at 2024-04-22 03:43:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:43:02,770 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:43:03,069 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:43:03,158 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:43:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:13.759375+00:00 (in 9.999525 seconds)
notificationworker stdout | 2024-04-22 03:43:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:13 UTC)" (scheduled at 2024-04-22 03:43:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 3, 760120), True, datetime.datetime(2024, 4, 22, 3, 43, 3, 760120), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:43:04,311 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:43:04,316 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:43:04,318 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:43:04,328 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:43:05,413 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:43:05,577 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:43:05,812 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:26.873109+00:00 (in 21.000766 seconds)
securityworker stdout | 2024-04-22 03:43:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:35 UTC)" (scheduled at 2024-04-22 03:43:05.871852+00:00)
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:43:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:13.555667+00:00 (in 7.002688 seconds)
repositorygcworker stdout | 2024-04-22 03:43:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:06 UTC)" (scheduled at 2024-04-22 03:43:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:43:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:43:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 6, 553345), True, datetime.datetime(2024, 4, 22, 3, 43, 6, 553345), 0, 'repositorygc/%', 50, 1, 0])
blobuploadcleanupworker stdout | 2024-04-22 03:43:06,562 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:43:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:43:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:43:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:43:08,005 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:43:08,049 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:43:08,474 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:43:08,611 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:43:09,684 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:43:10,522 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:43:10,531 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:43:10,534 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:43:10,537 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:43:10,542 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:43:10,544 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:43:10,547 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:43:10,553 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:43:10,558 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:43:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:43:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:41.264267+00:00 (in 29.999403 seconds)
autopruneworker stdout | 2024-04-22 03:43:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:41 UTC)" (scheduled at 2024-04-22 03:43:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:43:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757331271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:43:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:43:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:43:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:06.552482+00:00 (in 52.996292 seconds)
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:13 UTC)" (scheduled at 2024-04-22 03:43:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:19.762160+00:00 (in 6.002329 seconds)
notificationworker stdout | 2024-04-22 03:43:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:23 UTC)" (scheduled at 2024-04-22 03:43:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 13, 760097), True, datetime.datetime(2024, 4, 22, 3, 43, 13, 760097), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:43:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:43:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:44.952062+00:00 (in 29.999510 seconds)
gcworker stdout | 2024-04-22 03:43:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:44 UTC)" (scheduled at 2024-04-22 03:43:14.952062+00:00)
gcworker stdout | 2024-04-22 03:43:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:43:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:43:15,653 [278] [DEBUG] [app] Starting request: urn:request:b5bcd5cb-4ffb-403e-92e9-2b9837bcd288 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:15,653 [282] [DEBUG] [app] Starting request: urn:request:a46565c2-9470-4b18-aac4-057c1be15131 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:15,656 [284] [DEBUG] [app] Starting request: urn:request:e4df9379-e246-42f2-8440-f389f6b74265 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [292] [DEBUG] [app] Starting request: urn:request:45d9e7da-5aad-4dd0-bc54-68297ff43785 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [284] [DEBUG] [app] Ending request: urn:request:e4df9379-e246-42f2-8440-f389f6b74265 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e4df9379-e246-42f2-8440-f389f6b74265', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [292] [DEBUG] [app] Ending request: urn:request:45d9e7da-5aad-4dd0-bc54-68297ff43785 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:45d9e7da-5aad-4dd0-bc54-68297ff43785', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [DEBUG] [app] Starting request: urn:request:2971fa37-b452-4e0d-8075-b922803ea37a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [DEBUG] [app] Ending request: urn:request:2971fa37-b452-4e0d-8075-b922803ea37a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2971fa37-b452-4e0d-8075-b922803ea37a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:15,660 [279] [DEBUG] [app] Starting request: urn:request:1cfbab1b-2cda-4fdb-9ef3-016af74b1aa7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,660 [279] [DEBUG] [app] Ending request: urn:request:1cfbab1b-2cda-4fdb-9ef3-016af74b1aa7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1cfbab1b-2cda-4fdb-9ef3-016af74b1aa7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:43:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:15,674 [282] [DEBUG] [app] Ending request: urn:request:a46565c2-9470-4b18-aac4-057c1be15131 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a46565c2-9470-4b18-aac4-057c1be15131', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:15,675 [278] [DEBUG] [app] Ending request: urn:request:b5bcd5cb-4ffb-403e-92e9-2b9837bcd288 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5bcd5cb-4ffb-403e-92e9-2b9837bcd288', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:43:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:43:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:02.556208+00:00 (in 46.003258 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:16 UTC)" (scheduled at 2024-04-22 03:43:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 16, 553215), True, datetime.datetime(2024, 4, 22, 3, 43, 16, 553215), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:43:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:43:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:47.052354+00:00 (in 29.999501 seconds)
buildlogsarchiver stdout | 2024-04-22 03:43:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:47 UTC)" (scheduled at 2024-04-22 03:43:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:43:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 43, 17, 53269), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:43:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:43:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:43:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:43:18,895 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:43:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:23.759375+00:00 (in 3.996640 seconds)
notificationworker stdout | 2024-04-22 03:43:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:48:19 UTC)" (scheduled at 2024-04-22 03:43:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:43:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 'notification/%'])
notificationworker stdout | 2024-04-22 03:43:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:19 UTC)" (scheduled at 2024-04-22 03:43:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:43:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:43:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), True, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:43:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), True, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 'notification/%'])
notificationworker stdout | 2024-04-22 03:43:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:48:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:43:20,518 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:43.057186+00:00 (in 20.997677 seconds)
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:22 UTC)" (scheduled at 2024-04-22 03:43:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:33.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 03:43:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:33 UTC)" (scheduled at 2024-04-22 03:43:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 23, 760209), True, datetime.datetime(2024, 4, 22, 3, 43, 23, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:43:23,996 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:24 UTC)" (scheduled at 2024-04-22 03:43:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:43:25,570 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:43:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:35.871852+00:00 (in 8.998287 seconds)
securityworker stdout | 2024-04-22 03:43:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:56 UTC)" (scheduled at 2024-04-22 03:43:26.873109+00:00)
securityworker stdout | 2024-04-22 03:43:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:43:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:43:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:43:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 38, 26, 881639), 1, 2])
securityworker stdout | 2024-04-22 03:43:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 38, 26, 881639), 1, 2])
securityworker stdout | 2024-04-22 03:43:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:27,024 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:43:28,957 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:43:28,960 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:43:29,711 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:43:29,721 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:43:29,724 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:43:29,728 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:43:29,731 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:43:29,999 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:43:30,653 [281] [DEBUG] [app] Starting request: urn:request:a1736362-79ef-4d44-b92a-fc77f186bc5c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:30,653 [278] [DEBUG] [app] Starting request: urn:request:105e32b9-1b0c-44e0-9406-8b73209e3866 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [292] [DEBUG] [app] Starting request: urn:request:fd7470d1-c03e-4cc7-a594-0184a7a1691e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [284] [DEBUG] [app] Starting request: urn:request:5fb24357-4740-449f-8476-84dfdd534f05 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [292] [DEBUG] [app] Ending request: urn:request:fd7470d1-c03e-4cc7-a594-0184a7a1691e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fd7470d1-c03e-4cc7-a594-0184a7a1691e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [284] [DEBUG] [app] Ending request: urn:request:5fb24357-4740-449f-8476-84dfdd534f05 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5fb24357-4740-449f-8476-84dfdd534f05', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:43:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:43:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:30,659 [278] [DEBUG] [app] Starting request: urn:request:3dc8a9aa-5438-4c7a-b91f-529d3f6ce84d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:30,659 [278] [DEBUG] [app] Ending request: urn:request:3dc8a9aa-5438-4c7a-b91f-529d3f6ce84d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3dc8a9aa-5438-4c7a-b91f-529d3f6ce84d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:30,660 [279] [DEBUG] [app] Starting request: urn:request:bb508455-3524-463b-9226-4218a5b8a82d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:30,660 [279] [DEBUG] [app] Ending request: urn:request:bb508455-3524-463b-9226-4218a5b8a82d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bb508455-3524-463b-9226-4218a5b8a82d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:30,674 [281] [DEBUG] [app] Ending request: urn:request:a1736362-79ef-4d44-b92a-fc77f186bc5c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1736362-79ef-4d44-b92a-fc77f186bc5c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:43:30,675 [278] [DEBUG] [app] Ending request: urn:request:105e32b9-1b0c-44e0-9406-8b73209e3866 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:105e32b9-1b0c-44e0-9406-8b73209e3866', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:43:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:43:31,446 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:43:32,778 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:43:33,107 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:43:33,194 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:43:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:43.759375+00:00 (in 9.999473 seconds)
notificationworker stdout | 2024-04-22 03:43:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:43 UTC)" (scheduled at 2024-04-22 03:43:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 33, 760425), True, datetime.datetime(2024, 4, 22, 3, 43, 33, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:43:34,320 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:43:34,323 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:43:34,326 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:43:34,361 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:43:35,432 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:43:35,613 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:43:35,843 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:56.873109+00:00 (in 21.000819 seconds)
securityworker stdout | 2024-04-22 03:43:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:05 UTC)" (scheduled at 2024-04-22 03:43:35.871852+00:00)
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:43:36,602 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:43:38,044 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:43:38,061 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:43:38,510 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:43:38,626 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:41.564959+00:00 (in 1.997485 seconds)
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:39 UTC)" (scheduled at 2024-04-22 03:43:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:43:39,724 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:43:40,534 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:43:40,543 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:43:40,546 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:43:40,551 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:43:40,554 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:43:40,558 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:43:40,561 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:43:40,565 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:43:40,568 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:43:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:43:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:11.264267+00:00 (in 29.999402 seconds)
autopruneworker stdout | 2024-04-22 03:43:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:11 UTC)" (scheduled at 2024-04-22 03:43:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:43:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757361271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:43:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:43:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:43:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:39.566970+00:00 (in 58.001521 seconds)
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:41 UTC)" (scheduled at 2024-04-22 03:43:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:43:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 41, 565707), True, datetime.datetime(2024, 4, 22, 3, 43, 41, 565707), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:43:41,586 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:43:41,586 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:43:41,586 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:22.058978+00:00 (in 39.001310 seconds)
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:43 UTC)" (scheduled at 2024-04-22 03:43:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:43:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 43, 57988), True, datetime.datetime(2024, 4, 22, 3, 43, 43, 57988), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:43:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:43:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:43:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:53.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 03:43:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:53 UTC)" (scheduled at 2024-04-22 03:43:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 43, 760203), True, datetime.datetime(2024, 4, 22, 3, 43, 43, 760203), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:43:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:43:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:14.952062+00:00 (in 29.999546 seconds)
gcworker stdout | 2024-04-22 03:43:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:14 UTC)" (scheduled at 2024-04-22 03:43:44.952062+00:00)
gcworker stdout | 2024-04-22 03:43:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:43:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:43:45,653 [278] [DEBUG] [app] Starting request: urn:request:635c7e31-36db-4fa8-8d0a-182b6a4111ef (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:45,653 [279] [DEBUG] [app] Starting request: urn:request:e1a28a67-1638-4959-8238-4f65f55a22c3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:45,657 [284] [DEBUG] [app] Starting request: urn:request:05c8edfd-752c-4deb-8d16-1ba2bb2b006b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:45,657 [288] [DEBUG] [app] Starting request: urn:request:6638a23a-36db-472e-bbfb-564f04dd9bd0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [284] [DEBUG] [app] Ending request: urn:request:05c8edfd-752c-4deb-8d16-1ba2bb2b006b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05c8edfd-752c-4deb-8d16-1ba2bb2b006b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [288] [DEBUG] [app] Ending request: urn:request:6638a23a-36db-472e-bbfb-564f04dd9bd0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6638a23a-36db-472e-bbfb-564f04dd9bd0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:45,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:45,659 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:43:45,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:45,661 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:45,662 [278] [DEBUG] [app] Starting request: urn:request:1178c58f-7ae1-4630-a078-ffbf4ac23cf9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:45,662 [279] [DEBUG] [app] Starting request: urn:request:1c0eabd3-3aa8-45e5-84ae-f748f2eb7cee (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:45,662 [278] [DEBUG] [app] Ending request: urn:request:1178c58f-7ae1-4630-a078-ffbf4ac23cf9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1178c58f-7ae1-4630-a078-ffbf4ac23cf9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:45,662 [279] [DEBUG] [app] Ending request: urn:request:1c0eabd3-3aa8-45e5-84ae-f748f2eb7cee (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1c0eabd3-3aa8-45e5-84ae-f748f2eb7cee', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:45,663 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:45,663 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:45,663 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:45,663 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:45,664 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:45,670 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:45,671 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:45,679 [278] [DEBUG] [app] Ending request: urn:request:635c7e31-36db-4fa8-8d0a-182b6a4111ef (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:635c7e31-36db-4fa8-8d0a-182b6a4111ef', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:45,679 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:45,680 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
gunicorn-web stdout | 2024-04-22 03:43:45,682 [279] [DEBUG] [app] Ending request: urn:request:e1a28a67-1638-4959-8238-4f65f55a22c3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e1a28a67-1638-4959-8238-4f65f55a22c3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:45,682 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:45,683 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.031)
buildlogsarchiver stdout | 2024-04-22 03:43:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:43:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:17.052354+00:00 (in 29.999509 seconds)
buildlogsarchiver stdout | 2024-04-22 03:43:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:17 UTC)" (scheduled at 2024-04-22 03:43:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:43:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 43, 47, 53240), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:43:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:43:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:43:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:43:48,931 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:43:50,543 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:43:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:03.759375+00:00 (in 9.999465 seconds)
notificationworker stdout | 2024-04-22 03:43:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:03 UTC)" (scheduled at 2024-04-22 03:43:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 53, 760404), True, datetime.datetime(2024, 4, 22, 3, 43, 53, 760404), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:53,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:43:54,017 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:43:55,606 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:05.871852+00:00 (in 8.998224 seconds)
securityworker stdout | 2024-04-22 03:43:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:26 UTC)" (scheduled at 2024-04-22 03:43:56.873109+00:00)
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:43:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:43:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:43:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 38, 56, 881092), 1, 2])
securityworker stdout | 2024-04-22 03:43:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 38, 56, 881092), 1, 2])
securityworker stdout | 2024-04-22 03:43:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:43:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:57,059 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:43:58,995 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:43:58,999 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:43:59,720 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:43:59,728 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:43:59,732 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:43:59,735 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:43:59,738 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:44:00,036 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:44:00,653 [281] [DEBUG] [app] Starting request: urn:request:123c6b13-e7f9-4518-a556-8ef863814e21 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:00,653 [282] [DEBUG] [app] Starting request: urn:request:fa06c627-c1a4-4a85-86a0-0075bb5234cd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [284] [DEBUG] [app] Starting request: urn:request:bdcc9d3f-2c40-41a2-8bd6-027312a2a3a1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [292] [DEBUG] [app] Starting request: urn:request:f5e6b651-2e9c-4348-91d6-1380527b1b58 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [284] [DEBUG] [app] Ending request: urn:request:bdcc9d3f-2c40-41a2-8bd6-027312a2a3a1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bdcc9d3f-2c40-41a2-8bd6-027312a2a3a1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [292] [DEBUG] [app] Ending request: urn:request:f5e6b651-2e9c-4348-91d6-1380527b1b58 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f5e6b651-2e9c-4348-91d6-1380527b1b58', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:44:00,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:44:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:00,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:00,661 [281] [DEBUG] [app] Starting request: urn:request:65d6ce06-84ff-465b-bbb9-3507ceea89be (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:00,661 [279] [DEBUG] [app] Starting request: urn:request:f90d38e3-59a2-4adb-9255-2b023344dd3d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:00,661 [281] [DEBUG] [app] Ending request: urn:request:65d6ce06-84ff-465b-bbb9-3507ceea89be (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:65d6ce06-84ff-465b-bbb9-3507ceea89be', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:00,662 [279] [DEBUG] [app] Ending request: urn:request:f90d38e3-59a2-4adb-9255-2b023344dd3d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f90d38e3-59a2-4adb-9255-2b023344dd3d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:00,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:00,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:00,677 [282] [DEBUG] [app] Ending request: urn:request:fa06c627-c1a4-4a85-86a0-0075bb5234cd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fa06c627-c1a4-4a85-86a0-0075bb5234cd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:00,677 [281] [DEBUG] [app] Ending request: urn:request:123c6b13-e7f9-4518-a556-8ef863814e21 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:123c6b13-e7f9-4518-a556-8ef863814e21', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:00,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:00,678 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:44:00,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:44:00,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:44:01,482 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:16.552337+00:00 (in 13.995646 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:02 UTC)" (scheduled at 2024-04-22 03:44:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:44:02,815 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:44:03,131 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:44:03,229 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:44:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:13.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 03:44:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:13 UTC)" (scheduled at 2024-04-22 03:44:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 3, 760210), True, datetime.datetime(2024, 4, 22, 3, 44, 3, 760210), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:03,775 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:03,775 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:03,775 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:44:04,329 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:44:04,333 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:44:04,336 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:44:04,367 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:44:05,457 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:44:05,649 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:26.873109+00:00 (in 21.000786 seconds)
securityworker stdout | 2024-04-22 03:44:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:35 UTC)" (scheduled at 2024-04-22 03:44:05.871852+00:00)
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
globalpromstats stdout | 2024-04-22 03:44:05,878 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:44:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:44:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:44:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:13.555667+00:00 (in 7.002647 seconds)
repositorygcworker stdout | 2024-04-22 03:44:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:06 UTC)" (scheduled at 2024-04-22 03:44:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:44:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:44:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 6, 553436), True, datetime.datetime(2024, 4, 22, 3, 44, 6, 553436), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:44:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:44:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:44:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:44:06,639 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:44:08,080 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:44:08,097 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:44:08,546 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:44:08,663 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:44:09,761 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:44:10,546 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:44:10,555 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:44:10,558 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:44:10,561 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:44:10,565 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:44:10,569 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:44:10,571 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:44:10,574 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:44:10,576 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:44:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:44:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:41.264267+00:00 (in 29.999542 seconds)
autopruneworker stdout | 2024-04-22 03:44:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:41 UTC)" (scheduled at 2024-04-22 03:44:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:44:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757391271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:44:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:44:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:44:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:06.552482+00:00 (in 52.996291 seconds)
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:13 UTC)" (scheduled at 2024-04-22 03:44:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:44:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:19.762424+00:00 (in 6.002535 seconds)
notificationworker stdout | 2024-04-22 03:44:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:23 UTC)" (scheduled at 2024-04-22 03:44:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 13, 760359), True, datetime.datetime(2024, 4, 22, 3, 44, 13, 760359), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:44:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:44:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:44.952062+00:00 (in 29.999553 seconds)
gcworker stdout | 2024-04-22 03:44:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:44 UTC)" (scheduled at 2024-04-22 03:44:14.952062+00:00)
gcworker stdout | 2024-04-22 03:44:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:44:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:44:15,652 [282] [DEBUG] [app] Starting request: urn:request:26dd0844-fce1-488e-b904-e8164baa5cf4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:15,652 [281] [DEBUG] [app] Starting request: urn:request:4bb79d24-be81-4159-b2df-cc1407a11789 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [284] [DEBUG] [app] Starting request: urn:request:e10e4438-483a-4a8e-a78d-4e3db14708ab (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [292] [DEBUG] [app] Starting request: urn:request:64b38c85-89a2-4b06-ae66-87c3ff3d7b8b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [284] [DEBUG] [app] Ending request: urn:request:e10e4438-483a-4a8e-a78d-4e3db14708ab (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e10e4438-483a-4a8e-a78d-4e3db14708ab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [292] [DEBUG] [app] Ending request: urn:request:64b38c85-89a2-4b06-ae66-87c3ff3d7b8b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:64b38c85-89a2-4b06-ae66-87c3ff3d7b8b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:44:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 03:44:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [DEBUG] [app] Starting request: urn:request:db68d21d-467d-408d-a4e8-42fc0a35eeea (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [281] [DEBUG] [app] Starting request: urn:request:06d8a85c-7c15-4c3f-83b3-cca2b54f7b6f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [DEBUG] [app] Ending request: urn:request:db68d21d-467d-408d-a4e8-42fc0a35eeea (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:db68d21d-467d-408d-a4e8-42fc0a35eeea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [281] [DEBUG] [app] Ending request: urn:request:06d8a85c-7c15-4c3f-83b3-cca2b54f7b6f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:06d8a85c-7c15-4c3f-83b3-cca2b54f7b6f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:44:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:15,675 [282] [DEBUG] [app] Ending request: urn:request:26dd0844-fce1-488e-b904-e8164baa5cf4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:26dd0844-fce1-488e-b904-e8164baa5cf4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:44:15,676 [281] [DEBUG] [app] Ending request: urn:request:4bb79d24-be81-4159-b2df-cc1407a11789 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4bb79d24-be81-4159-b2df-cc1407a11789', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:02.556208+00:00 (in 46.003232 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:16 UTC)" (scheduled at 2024-04-22 03:44:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 16, 553391), True, datetime.datetime(2024, 4, 22, 3, 44, 16, 553391), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:44:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:44:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:47.052354+00:00 (in 29.999475 seconds)
buildlogsarchiver stdout | 2024-04-22 03:44:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:47 UTC)" (scheduled at 2024-04-22 03:44:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:44:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 44, 17, 53245), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:44:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:44:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:44:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:44:18,968 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:44:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:23.759375+00:00 (in 3.996391 seconds)
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:19 UTC)" (scheduled at 2024-04-22 03:44:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:44:20,558 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:43.057186+00:00 (in 20.997716 seconds)
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:22 UTC)" (scheduled at 2024-04-22 03:44:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:44:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:33.759375+00:00 (in 9.999523 seconds)
notificationworker stdout | 2024-04-22 03:44:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:33 UTC)" (scheduled at 2024-04-22 03:44:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 23, 760250), True, datetime.datetime(2024, 4, 22, 3, 44, 23, 760250), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:44:24,054 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:24.361582+00:00 (in 59.999474 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:24 UTC)" (scheduled at 2024-04-22 03:44:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:44:25,642 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:44:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:35.871852+00:00 (in 8.998252 seconds)
securityworker stdout | 2024-04-22 03:44:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:56 UTC)" (scheduled at 2024-04-22 03:44:26.873109+00:00)
securityworker stdout | 2024-04-22 03:44:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:44:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:44:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:44:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 39, 26, 880690), 1, 2])
securityworker stdout | 2024-04-22 03:44:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 39, 26, 880690), 1, 2])
securityworker stdout | 2024-04-22 03:44:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:44:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:27,095 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:44:29,031 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:44:29,036 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:44:29,728 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:44:29,735 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:44:29,740 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:44:29,743 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:44:29,746 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:44:30,072 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:44:30,652 [278] [DEBUG] [app] Starting request: urn:request:c2aa374f-04d4-4dfe-811a-5e7b92e3f020 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:30,652 [282] [DEBUG] [app] Starting request: urn:request:68d157a5-8fae-4727-9db2-9946e7ea390d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:30,656 [291] [DEBUG] [app] Starting request: urn:request:9e922ff3-7bf3-4771-8e10-e9b6b3ef4e40 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:30,656 [284] [DEBUG] [app] Starting request: urn:request:170e253c-1599-4853-9c01-d0f75ad81848 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [291] [DEBUG] [app] Ending request: urn:request:9e922ff3-7bf3-4771-8e10-e9b6b3ef4e40 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9e922ff3-7bf3-4771-8e10-e9b6b3ef4e40', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [284] [DEBUG] [app] Ending request: urn:request:170e253c-1599-4853-9c01-d0f75ad81848 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:170e253c-1599-4853-9c01-d0f75ad81848', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:44:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:30,661 [278] [DEBUG] [app] Starting request: urn:request:b25472ea-c857-46e0-8583-109ac535bdc6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:30,661 [278] [DEBUG] [app] Ending request: urn:request:b25472ea-c857-46e0-8583-109ac535bdc6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b25472ea-c857-46e0-8583-109ac535bdc6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:30,661 [281] [DEBUG] [app] Starting request: urn:request:e6fa1c43-2875-4777-926b-c5df281ed216 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:44:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:30,661 [281] [DEBUG] [app] Ending request: urn:request:e6fa1c43-2875-4777-926b-c5df281ed216 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e6fa1c43-2875-4777-926b-c5df281ed216', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:30,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:30,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:30,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:30,677 [282] [DEBUG] [app] Ending request: urn:request:68d157a5-8fae-4727-9db2-9946e7ea390d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:68d157a5-8fae-4727-9db2-9946e7ea390d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:30,677 [278] [DEBUG] [app] Ending request: urn:request:c2aa374f-04d4-4dfe-811a-5e7b92e3f020 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c2aa374f-04d4-4dfe-811a-5e7b92e3f020', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:30,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:30,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:44:30,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:44:31,518 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:44:32,851 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:44:33,156 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:44:33,266 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:44:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:33,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:43.759375+00:00 (in 9.999391 seconds)
notificationworker stdout | 2024-04-22 03:44:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:43 UTC)" (scheduled at 2024-04-22 03:44:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 33, 760278), True, datetime.datetime(2024, 4, 22, 3, 44, 33, 760278), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:44:34,339 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:44:34,341 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:44:34,344 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:44:34,373 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:44:35,493 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:44:35,685 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:56.873109+00:00 (in 21.000811 seconds)
securityworker stdout | 2024-04-22 03:44:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:05 UTC)" (scheduled at 2024-04-22 03:44:35.871852+00:00)
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
globalpromstats stdout | 2024-04-22 03:44:35,887 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:44:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:44:36,675 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:44:38,116 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:44:38,132 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:44:38,582 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:44:38,700 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:41.564959+00:00 (in 1.997528 seconds)
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:39 UTC)" (scheduled at 2024-04-22 03:44:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:44:39,797 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:44:40,555 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:44:40,566 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:44:40,569 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:44:40,572 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:44:40,577 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:44:40,582 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:44:40,585 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:44:40,589 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:44:40,592 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:44:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:44:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:11.264267+00:00 (in 29.999521 seconds)
autopruneworker stdout | 2024-04-22 03:44:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:11 UTC)" (scheduled at 2024-04-22 03:44:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:44:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757421271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:44:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:44:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:44:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:39.566970+00:00 (in 58.001567 seconds)
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:41 UTC)" (scheduled at 2024-04-22 03:44:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:44:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 41, 565648), True, datetime.datetime(2024, 4, 22, 3, 44, 41, 565648), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:44:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:44:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:44:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:22.058978+00:00 (in 39.001312 seconds)
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:43 UTC)" (scheduled at 2024-04-22 03:44:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:44:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 43, 57941), True, datetime.datetime(2024, 4, 22, 3, 44, 43, 57941), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:44:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:44:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:44:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:44:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:53.759375+00:00 (in 9.999429 seconds)
notificationworker stdout | 2024-04-22 03:44:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:53 UTC)" (scheduled at 2024-04-22 03:44:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 43, 760407), True, datetime.datetime(2024, 4, 22, 3, 44, 43, 760407), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:44:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:44:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:14.952062+00:00 (in 29.999556 seconds)
gcworker stdout | 2024-04-22 03:44:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:14 UTC)" (scheduled at 2024-04-22 03:44:44.952062+00:00)
gcworker stdout | 2024-04-22 03:44:44,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 03:44:44,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547884962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:44:44,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:44:44,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:44:44,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:44:45,653 [278] [DEBUG] [app] Starting request: urn:request:a95f6e81-c64f-403a-9074-02002d700564 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:45,653 [279] [DEBUG] [app] Starting request: urn:request:9a8e0549-42b2-44c7-a6d3-b98c74c865c9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:45,656 [284] [DEBUG] [app] Starting request: urn:request:1c1830db-30d7-49e4-b735-8a640a6aec72 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:45,656 [292] [DEBUG] [app] Starting request: urn:request:880fff4e-f339-41be-8b37-2bdf6d8e20eb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [284] [DEBUG] [app] Ending request: urn:request:1c1830db-30d7-49e4-b735-8a640a6aec72 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1c1830db-30d7-49e4-b735-8a640a6aec72', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [292] [DEBUG] [app] Ending request: urn:request:880fff4e-f339-41be-8b37-2bdf6d8e20eb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:880fff4e-f339-41be-8b37-2bdf6d8e20eb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:44:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:45,660 [278] [DEBUG] [app] Starting request: urn:request:b51601a7-efba-4ffe-9b39-8cf0bb26e048 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:45,660 [278] [DEBUG] [app] Ending request: urn:request:b51601a7-efba-4ffe-9b39-8cf0bb26e048 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b51601a7-efba-4ffe-9b39-8cf0bb26e048', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:44:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:45,661 [282] [DEBUG] [app] Starting request: urn:request:beef784a-bdbf-4f1f-800e-455121e18526 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:45,661 [282] [DEBUG] [app] Ending request: urn:request:beef784a-bdbf-4f1f-800e-455121e18526 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:beef784a-bdbf-4f1f-800e-455121e18526', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:45,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:45,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:45,675 [278] [DEBUG] [app] Ending request: urn:request:a95f6e81-c64f-403a-9074-02002d700564 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a95f6e81-c64f-403a-9074-02002d700564', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:44:45,676 [279] [DEBUG] [app] Ending request: urn:request:9a8e0549-42b2-44c7-a6d3-b98c74c865c9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9a8e0549-42b2-44c7-a6d3-b98c74c865c9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:45,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:45,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
buildlogsarchiver stdout | 2024-04-22 03:44:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:44:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:17.052354+00:00 (in 29.999471 seconds)
buildlogsarchiver stdout | 2024-04-22 03:44:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:17 UTC)" (scheduled at 2024-04-22 03:44:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:44:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 44, 47, 53228), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:44:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:44:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:44:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:44:49,005 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:44:50,571 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:44:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:03.759375+00:00 (in 9.999429 seconds)
notificationworker stdout | 2024-04-22 03:44:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:03 UTC)" (scheduled at 2024-04-22 03:44:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 53, 760333), True, datetime.datetime(2024, 4, 22, 3, 44, 53, 760333), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:44:54,090 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:44:55,679 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:05.871852+00:00 (in 8.998286 seconds)
securityworker stdout | 2024-04-22 03:44:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:26 UTC)" (scheduled at 2024-04-22 03:44:56.873109+00:00)
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:44:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:44:56,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:44:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 39, 56, 880505), 1, 2])
securityworker stdout | 2024-04-22 03:44:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 39, 56, 880505), 1, 2])
securityworker stdout | 2024-04-22 03:44:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:44:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:57,132 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:44:59,068 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:44:59,073 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:44:59,736 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:44:59,746 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:44:59,749 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:44:59,751 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:44:59,754 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:45:00,108 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:45:00,653 [282] [DEBUG] [app] Starting request: urn:request:2f1029f6-f113-4c47-88c3-0d26ab317c2c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:00,653 [278] [DEBUG] [app] Starting request: urn:request:0628b4b7-b29d-4776-8166-db1efa2dfb74 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [284] [DEBUG] [app] Starting request: urn:request:7b99091c-56d0-48c4-b675-544023365b19 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [289] [DEBUG] [app] Starting request: urn:request:34f380aa-2ee6-41bd-9d2a-ba97b037249d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [284] [DEBUG] [app] Ending request: urn:request:7b99091c-56d0-48c4-b675-544023365b19 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7b99091c-56d0-48c4-b675-544023365b19', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [289] [DEBUG] [app] Ending request: urn:request:34f380aa-2ee6-41bd-9d2a-ba97b037249d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:34f380aa-2ee6-41bd-9d2a-ba97b037249d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:45:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:45:00,658 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:45:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:00,661 [279] [DEBUG] [app] Starting request: urn:request:566757b8-4578-4f4d-8063-ccabef0e2fde (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [282] [DEBUG] [app] Starting request: urn:request:a2e9aef0-c20a-4b22-a8c5-1b8cc859d071 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [282] [DEBUG] [app] Ending request: urn:request:a2e9aef0-c20a-4b22-a8c5-1b8cc859d071 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a2e9aef0-c20a-4b22-a8c5-1b8cc859d071', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [279] [DEBUG] [app] Ending request: urn:request:566757b8-4578-4f4d-8063-ccabef0e2fde (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:566757b8-4578-4f4d-8063-ccabef0e2fde', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:00,676 [278] [DEBUG] [app] Ending request: urn:request:0628b4b7-b29d-4776-8166-db1efa2dfb74 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0628b4b7-b29d-4776-8166-db1efa2dfb74', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:00,676 [282] [DEBUG] [app] Ending request: urn:request:2f1029f6-f113-4c47-88c3-0d26ab317c2c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f1029f6-f113-4c47-88c3-0d26ab317c2c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:45:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:45:01,555 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:16.552337+00:00 (in 13.995634 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:02 UTC)" (scheduled at 2024-04-22 03:45:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:45:02,874 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:45:03,187 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:45:03,302 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:45:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:13.759375+00:00 (in 9.999492 seconds)
notificationworker stdout | 2024-04-22 03:45:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:13 UTC)" (scheduled at 2024-04-22 03:45:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 3, 760168), True, datetime.datetime(2024, 4, 22, 3, 45, 3, 760168), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:45:04,349 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:45:04,352 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:45:04,355 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:45:04,408 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:45:05,529 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:45:05,722 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:45:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 03:45:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:35 UTC)" (scheduled at 2024-04-22 03:45:05.871852+00:00)
securityworker stdout | 2024-04-22 03:45:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:05,889 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:05,891 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:05,891 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:35 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:45:05,923 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:45:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:45:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:13.555667+00:00 (in 7.002699 seconds)
repositorygcworker stdout | 2024-04-22 03:45:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:06 UTC)" (scheduled at 2024-04-22 03:45:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:45:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:45:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 6, 553254), True, datetime.datetime(2024, 4, 22, 3, 45, 6, 553254), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:45:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:45:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:45:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:45:06,711 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:45:08,127 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:45:08,167 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:45:08,621 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:45:08,727 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:45:09,833 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:45:10,565 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:45:10,575 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:45:10,580 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:45:10,583 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:45:10,587 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:45:10,591 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:45:10,595 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:45:10,599 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:45:10,602 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:45:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:45:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:41.264267+00:00 (in 29.999524 seconds)
autopruneworker stdout | 2024-04-22 03:45:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:41 UTC)" (scheduled at 2024-04-22 03:45:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:45:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757451271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:45:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:45:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:45:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:45:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:06.552482+00:00 (in 52.996326 seconds)
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:13 UTC)" (scheduled at 2024-04-22 03:45:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:45:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:19.762424+00:00 (in 6.002511 seconds)
notificationworker stdout | 2024-04-22 03:45:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:23 UTC)" (scheduled at 2024-04-22 03:45:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 13, 760343), True, datetime.datetime(2024, 4, 22, 3, 45, 13, 760343), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:45:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:45:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:44.952062+00:00 (in 29.999560 seconds)
gcworker stdout | 2024-04-22 03:45:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:44 UTC)" (scheduled at 2024-04-22 03:45:14.952062+00:00)
gcworker stdout | 2024-04-22 03:45:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547914952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:45:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:45:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:45:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:45:15,652 [282] [DEBUG] [app] Starting request: urn:request:b34c44cd-a7d4-4d3f-af0e-43181e613ed8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:15,652 [278] [DEBUG] [app] Starting request: urn:request:88bc068a-1586-48a5-9bb1-7892968e6191 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:15,656 [284] [DEBUG] [app] Starting request: urn:request:bc9b80dd-57a3-4a5b-be17-7e8cbf2f7be7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:15,656 [289] [DEBUG] [app] Starting request: urn:request:01161ae3-8ade-4bc9-9e6e-496a29ddb849 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:15,656 [284] [DEBUG] [app] Ending request: urn:request:bc9b80dd-57a3-4a5b-be17-7e8cbf2f7be7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bc9b80dd-57a3-4a5b-be17-7e8cbf2f7be7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:15,657 [289] [DEBUG] [app] Ending request: urn:request:01161ae3-8ade-4bc9-9e6e-496a29ddb849 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:01161ae3-8ade-4bc9-9e6e-496a29ddb849', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:45:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:45:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:15,660 [279] [DEBUG] [app] Starting request: urn:request:0e44f58e-6ed8-457d-8c96-31f19cedb798 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:15,660 [278] [DEBUG] [app] Starting request: urn:request:63ea54cd-6be4-4c0f-b6b4-5c4609c3e865 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:15,661 [279] [DEBUG] [app] Ending request: urn:request:0e44f58e-6ed8-457d-8c96-31f19cedb798 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0e44f58e-6ed8-457d-8c96-31f19cedb798', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:15,661 [278] [DEBUG] [app] Ending request: urn:request:63ea54cd-6be4-4c0f-b6b4-5c4609c3e865 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:63ea54cd-6be4-4c0f-b6b4-5c4609c3e865', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:15,676 [278] [DEBUG] [app] Ending request: urn:request:88bc068a-1586-48a5-9bb1-7892968e6191 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:88bc068a-1586-48a5-9bb1-7892968e6191', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:45:15,677 [282] [DEBUG] [app] Ending request: urn:request:b34c44cd-a7d4-4d3f-af0e-43181e613ed8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b34c44cd-a7d4-4d3f-af0e-43181e613ed8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:15,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:15,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:02.556208+00:00 (in 46.003341 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:16 UTC)" (scheduled at 2024-04-22 03:45:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 16, 553345), True, datetime.datetime(2024, 4, 22, 3, 45, 16, 553345), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:45:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:45:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:47.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 03:45:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:47 UTC)" (scheduled at 2024-04-22 03:45:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:45:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 45, 17, 53063), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:45:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:45:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:45:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:45:19,028 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:45:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:23.759375+00:00 (in 3.996387 seconds)
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:19 UTC)" (scheduled at 2024-04-22 03:45:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:45:20,579 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:43.057186+00:00 (in 20.997718 seconds)
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:22 UTC)" (scheduled at 2024-04-22 03:45:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:45:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:33.759375+00:00 (in 9.999483 seconds)
notificationworker stdout | 2024-04-22 03:45:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:33 UTC)" (scheduled at 2024-04-22 03:45:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 23, 760209), True, datetime.datetime(2024, 4, 22, 3, 45, 23, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:45:24,126 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:24 UTC)" (scheduled at 2024-04-22 03:45:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:45:25,715 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:35.871852+00:00 (in 8.998281 seconds)
securityworker stdout | 2024-04-22 03:45:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:56 UTC)" (scheduled at 2024-04-22 03:45:26.873109+00:00)
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:45:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:45:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:45:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 40, 26, 882402), 1, 2])
securityworker stdout | 2024-04-22 03:45:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 40, 26, 882402), 1, 2])
securityworker stdout | 2024-04-22 03:45:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:45:27,170 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:45:29,105 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:45:29,108 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:45:29,744 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:45:29,753 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:45:29,758 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:45:29,761 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:45:29,764 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:45:30,145 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:45:30,652 [281] [DEBUG] [app] Starting request: urn:request:8b88ef1d-ba22-43df-b1c6-0b8a01da5c2f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:30,652 [279] [DEBUG] [app] Starting request: urn:request:55a05e08-11ce-4c8b-b5b9-d6735a92a4b4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:30,656 [284] [DEBUG] [app] Starting request: urn:request:5c3fe2e5-16e1-480f-8952-129941d4ac44 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:30,656 [284] [DEBUG] [app] Ending request: urn:request:5c3fe2e5-16e1-480f-8952-129941d4ac44 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c3fe2e5-16e1-480f-8952-129941d4ac44', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:30,656 [292] [DEBUG] [app] Starting request: urn:request:cac5c3c8-b148-4ce6-9161-efda7b1145a1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:45:30,657 [292] [DEBUG] [app] Ending request: urn:request:cac5c3c8-b148-4ce6-9161-efda7b1145a1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cac5c3c8-b148-4ce6-9161-efda7b1145a1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:45:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:30,660 [279] [DEBUG] [app] Starting request: urn:request:1a4e9284-eea4-4dff-87ad-3ce09ee289bc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:30,660 [279] [DEBUG] [app] Ending request: urn:request:1a4e9284-eea4-4dff-87ad-3ce09ee289bc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1a4e9284-eea4-4dff-87ad-3ce09ee289bc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:30,661 [278] [DEBUG] [app] Starting request: urn:request:6f24bc41-76e1-429d-b0e7-034f7a2fe9b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:30,661 [278] [DEBUG] [app] Ending request: urn:request:6f24bc41-76e1-429d-b0e7-034f7a2fe9b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6f24bc41-76e1-429d-b0e7-034f7a2fe9b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:45:30,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:30,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:30,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:30,677 [279] [DEBUG] [app] Ending request: urn:request:55a05e08-11ce-4c8b-b5b9-d6735a92a4b4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:55a05e08-11ce-4c8b-b5b9-d6735a92a4b4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:30,677 [281] [DEBUG] [app] Ending request: urn:request:8b88ef1d-ba22-43df-b1c6-0b8a01da5c2f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8b88ef1d-ba22-43df-b1c6-0b8a01da5c2f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:30,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:30,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:45:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:45:31,591 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:45:32,905 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:45:33,223 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:45:33,340 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:45:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:43.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 03:45:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:43 UTC)" (scheduled at 2024-04-22 03:45:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 33, 760293), True, datetime.datetime(2024, 4, 22, 3, 45, 33, 760293), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:45:34,358 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:45:34,362 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:45:34,365 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:45:34,446 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:45:35,565 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:45:35,757 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:56.873109+00:00 (in 21.000810 seconds)
securityworker stdout | 2024-04-22 03:45:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:05 UTC)" (scheduled at 2024-04-22 03:45:35.871852+00:00)
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:05 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:45:35,959 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:45:36,747 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:45:38,157 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:45:38,198 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:45:38,657 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:45:38,737 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:41.564959+00:00 (in 1.997493 seconds)
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:39 UTC)" (scheduled at 2024-04-22 03:45:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:45:39,870 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:45:40,574 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:45:40,587 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:45:40,590 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:45:40,593 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:45:40,596 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:45:40,599 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:45:40,603 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:45:40,607 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:45:40,615 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:45:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:45:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:11.264267+00:00 (in 29.999517 seconds)
autopruneworker stdout | 2024-04-22 03:45:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:11 UTC)" (scheduled at 2024-04-22 03:45:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:45:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757481271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:45:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:45:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:45:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:39.566970+00:00 (in 58.001538 seconds)
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:41 UTC)" (scheduled at 2024-04-22 03:45:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:45:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 41, 565828), True, datetime.datetime(2024, 4, 22, 3, 45, 41, 565828), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:45:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:45:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:45:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:22.058978+00:00 (in 39.001327 seconds)
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:43 UTC)" (scheduled at 2024-04-22 03:45:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:45:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 43, 57934), True, datetime.datetime(2024, 4, 22, 3, 45, 43, 57934), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:45:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:45:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:45:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:45:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:53.759375+00:00 (in 9.999466 seconds)
notificationworker stdout | 2024-04-22 03:45:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:53 UTC)" (scheduled at 2024-04-22 03:45:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 43, 760234), True, datetime.datetime(2024, 4, 22, 3, 45, 43, 760234), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:45:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:45:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:14.952062+00:00 (in 29.999515 seconds)
gcworker stdout | 2024-04-22 03:45:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:14 UTC)" (scheduled at 2024-04-22 03:45:44.952062+00:00)
gcworker stdout | 2024-04-22 03:45:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547944952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:45:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:45:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:45:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:45:45,652 [278] [DEBUG] [app] Starting request: urn:request:fd31e4fd-641f-48b1-8380-2297c64ec156 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:45,652 [282] [DEBUG] [app] Starting request: urn:request:cc7fd089-16a7-49c0-b96f-1fc5f1c7b6af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:45,656 [284] [DEBUG] [app] Starting request: urn:request:cd0bc4bb-64f5-42e2-ae47-fe145de29c8d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [291] [DEBUG] [app] Starting request: urn:request:5b470346-8e05-4150-af68-a93ba4e175df (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [284] [DEBUG] [app] Ending request: urn:request:cd0bc4bb-64f5-42e2-ae47-fe145de29c8d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cd0bc4bb-64f5-42e2-ae47-fe145de29c8d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [291] [DEBUG] [app] Ending request: urn:request:5b470346-8e05-4150-af68-a93ba4e175df (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5b470346-8e05-4150-af68-a93ba4e175df', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:45,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:45,661 [279] [DEBUG] [app] Starting request: urn:request:2383e085-3cc5-4486-bf09-96b6f7884d1c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:45,661 [279] [DEBUG] [app] Ending request: urn:request:2383e085-3cc5-4486-bf09-96b6f7884d1c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2383e085-3cc5-4486-bf09-96b6f7884d1c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:45,661 [282] [DEBUG] [app] Starting request: urn:request:0f670764-fdc9-444e-9700-08afe64bc746 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:45,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:45,662 [282] [DEBUG] [app] Ending request: urn:request:0f670764-fdc9-444e-9700-08afe64bc746 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0f670764-fdc9-444e-9700-08afe64bc746', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:45:45,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:45,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:45,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:45,677 [278] [DEBUG] [app] Ending request: urn:request:fd31e4fd-641f-48b1-8380-2297c64ec156 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fd31e4fd-641f-48b1-8380-2297c64ec156', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:45,678 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:45,678 [282] [DEBUG] [app] Ending request: urn:request:cc7fd089-16a7-49c0-b96f-1fc5f1c7b6af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cc7fd089-16a7-49c0-b96f-1fc5f1c7b6af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:45,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:45,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:45:45,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:45:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:45:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:17.052354+00:00 (in 29.999498 seconds)
buildlogsarchiver stdout | 2024-04-22 03:45:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:17 UTC)" (scheduled at 2024-04-22 03:45:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:45:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 45, 47, 53122), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:45:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:45:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:45:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:45:49,060 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:45:50,610 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:45:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:03.759375+00:00 (in 9.999440 seconds)
notificationworker stdout | 2024-04-22 03:45:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:03 UTC)" (scheduled at 2024-04-22 03:45:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 53, 760246), True, datetime.datetime(2024, 4, 22, 3, 45, 53, 760246), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:53,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:45:54,162 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:45:55,751 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:05.871852+00:00 (in 8.998281 seconds)
securityworker stdout | 2024-04-22 03:45:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:26 UTC)" (scheduled at 2024-04-22 03:45:56.873109+00:00)
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:45:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:45:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:45:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 40, 56, 880758), 1, 2])
securityworker stdout | 2024-04-22 03:45:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 40, 56, 880758), 1, 2])
securityworker stdout | 2024-04-22 03:45:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:45:57,205 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:45:59,141 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:45:59,144 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:45:59,752 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:45:59,762 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:45:59,766 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:45:59,770 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:45:59,773 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:46:00,180 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:46:00,652 [282] [DEBUG] [app] Starting request: urn:request:593d400a-d818-4a83-9072-700578cb28ab (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:00,652 [279] [DEBUG] [app] Starting request: urn:request:00185fd8-9879-4d04-bbce-4905f5e9df75 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [285] [DEBUG] [app] Starting request: urn:request:35812cdf-da07-4709-a8b9-91cff6a2ec53 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [292] [DEBUG] [app] Starting request: urn:request:db568746-3ae6-4805-9dd2-4cfcf266cba1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [285] [DEBUG] [app] Ending request: urn:request:35812cdf-da07-4709-a8b9-91cff6a2ec53 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:35812cdf-da07-4709-a8b9-91cff6a2ec53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [292] [DEBUG] [app] Ending request: urn:request:db568746-3ae6-4805-9dd2-4cfcf266cba1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:db568746-3ae6-4805-9dd2-4cfcf266cba1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:00,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:46:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:46:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:00,659 [279] [DEBUG] [app] Starting request: urn:request:bf458e79-46cf-4bad-b1bf-0211f3617409 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:00,660 [278] [DEBUG] [app] Starting request: urn:request:264a27de-3a6b-4ee2-af76-0b0bdbbc392c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:00,660 [279] [DEBUG] [app] Ending request: urn:request:bf458e79-46cf-4bad-b1bf-0211f3617409 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bf458e79-46cf-4bad-b1bf-0211f3617409', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:00,660 [278] [DEBUG] [app] Ending request: urn:request:264a27de-3a6b-4ee2-af76-0b0bdbbc392c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:264a27de-3a6b-4ee2-af76-0b0bdbbc392c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:00,675 [282] [DEBUG] [app] Ending request: urn:request:593d400a-d818-4a83-9072-700578cb28ab (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:593d400a-d818-4a83-9072-700578cb28ab', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
gunicorn-web stdout | 2024-04-22 03:46:00,675 [279] [DEBUG] [app] Ending request: urn:request:00185fd8-9879-4d04-bbce-4905f5e9df75 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:00185fd8-9879-4d04-bbce-4905f5e9df75', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.024)
notificationworker stdout | 2024-04-22 03:46:01,628 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:16.552337+00:00 (in 13.995608 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:02 UTC)" (scheduled at 2024-04-22 03:46:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:46:02,931 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:46:03,260 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:46:03,376 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:46:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:13.759375+00:00 (in 9.999476 seconds)
notificationworker stdout | 2024-04-22 03:46:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:13 UTC)" (scheduled at 2024-04-22 03:46:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 3, 760415), True, datetime.datetime(2024, 4, 22, 3, 46, 3, 760415), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:46:04,367 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:46:04,371 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:46:04,374 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:46:04,457 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:46:05,601 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:46:05,793 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:46:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:26.873109+00:00 (in 21.000733 seconds)
securityworker stdout | 2024-04-22 03:46:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:35 UTC)" (scheduled at 2024-04-22 03:46:05.871852+00:00)
securityworker stdout | 2024-04-22 03:46:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:35 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:46:05,966 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:46:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:46:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:13.555667+00:00 (in 7.002695 seconds)
repositorygcworker stdout | 2024-04-22 03:46:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:06 UTC)" (scheduled at 2024-04-22 03:46:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:46:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:46:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 6, 553357), True, datetime.datetime(2024, 4, 22, 3, 46, 6, 553357), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:46:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:46:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:46:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:46:06,785 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:46:08,192 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:46:08,234 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:46:08,693 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:46:08,759 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:46:09,907 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:46:10,583 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:46:10,596 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:46:10,600 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:46:10,605 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:46:10,608 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:46:10,611 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:46:10,613 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:46:10,619 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:46:10,625 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:46:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:46:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:41.264267+00:00 (in 29.999516 seconds)
autopruneworker stdout | 2024-04-22 03:46:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:41 UTC)" (scheduled at 2024-04-22 03:46:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:46:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757511271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:46:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:46:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:46:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:46:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:51.555445+00:00 (in 37.999285 seconds)
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:13 UTC)" (scheduled at 2024-04-22 03:46:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:19.762424+00:00 (in 6.002548 seconds)
notificationworker stdout | 2024-04-22 03:46:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:23 UTC)" (scheduled at 2024-04-22 03:46:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 13, 760365), True, datetime.datetime(2024, 4, 22, 3, 46, 13, 760365), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:46:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:46:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:44.952062+00:00 (in 29.999552 seconds)
gcworker stdout | 2024-04-22 03:46:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:44 UTC)" (scheduled at 2024-04-22 03:46:14.952062+00:00)
gcworker stdout | 2024-04-22 03:46:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547974952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:46:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:46:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:46:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:46:15,653 [278] [DEBUG] [app] Starting request: urn:request:706535ce-8fdd-4106-8566-d22115131fcc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:15,653 [279] [DEBUG] [app] Starting request: urn:request:13c7fd34-5009-4079-aab4-ae43dbf0b84b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [288] [DEBUG] [app] Starting request: urn:request:22584145-eacb-4760-a3e2-18696181db52 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [284] [DEBUG] [app] Starting request: urn:request:f6bde8bb-a9fc-45fc-a2f9-a9b26e0b5722 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [284] [DEBUG] [app] Ending request: urn:request:f6bde8bb-a9fc-45fc-a2f9-a9b26e0b5722 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f6bde8bb-a9fc-45fc-a2f9-a9b26e0b5722', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [288] [DEBUG] [app] Ending request: urn:request:22584145-eacb-4760-a3e2-18696181db52 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:22584145-eacb-4760-a3e2-18696181db52', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:46:15,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:46:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:15,661 [279] [DEBUG] [app] Starting request: urn:request:069307e1-3a4d-477e-b9cf-f0cc0510911a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [282] [DEBUG] [app] Starting request: urn:request:8056c0ae-300a-4e5a-b06e-2bdf85c99c92 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [279] [DEBUG] [app] Ending request: urn:request:069307e1-3a4d-477e-b9cf-f0cc0510911a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:069307e1-3a4d-477e-b9cf-f0cc0510911a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [282] [DEBUG] [app] Ending request: urn:request:8056c0ae-300a-4e5a-b06e-2bdf85c99c92 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8056c0ae-300a-4e5a-b06e-2bdf85c99c92', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:15,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:15,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:15,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:15,676 [279] [DEBUG] [app] Ending request: urn:request:13c7fd34-5009-4079-aab4-ae43dbf0b84b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:13c7fd34-5009-4079-aab4-ae43dbf0b84b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:15,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:15,676 [278] [DEBUG] [app] Ending request: urn:request:706535ce-8fdd-4106-8566-d22115131fcc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:706535ce-8fdd-4106-8566-d22115131fcc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:15,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:46:15,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:46:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:02.556208+00:00 (in 46.003260 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:16 UTC)" (scheduled at 2024-04-22 03:46:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 16, 553334), True, datetime.datetime(2024, 4, 22, 3, 46, 16, 553334), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:46:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:46:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:47.052354+00:00 (in 29.999465 seconds)
buildlogsarchiver stdout | 2024-04-22 03:46:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:47 UTC)" (scheduled at 2024-04-22 03:46:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:46:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 46, 17, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:46:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:46:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:46:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:46:19,095 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:46:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:23.759375+00:00 (in 3.996375 seconds)
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:19 UTC)" (scheduled at 2024-04-22 03:46:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:46:20,623 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:43.057186+00:00 (in 20.997731 seconds)
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:22 UTC)" (scheduled at 2024-04-22 03:46:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:33.759375+00:00 (in 9.999472 seconds)
notificationworker stdout | 2024-04-22 03:46:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:33 UTC)" (scheduled at 2024-04-22 03:46:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 23, 760173), True, datetime.datetime(2024, 4, 22, 3, 46, 23, 760173), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:46:24,199 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:24 UTC)" (scheduled at 2024-04-22 03:46:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:46:25,789 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:46:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:35.871852+00:00 (in 8.998270 seconds)
securityworker stdout | 2024-04-22 03:46:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:56 UTC)" (scheduled at 2024-04-22 03:46:26.873109+00:00)
securityworker stdout | 2024-04-22 03:46:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:46:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:46:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:46:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 41, 26, 881081), 1, 2])
securityworker stdout | 2024-04-22 03:46:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 41, 26, 881081), 1, 2])
securityworker stdout | 2024-04-22 03:46:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:46:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:46:26,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:46:26,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:26,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:46:27,242 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:46:29,177 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:46:29,180 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:46:29,760 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:46:29,770 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:46:29,773 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:46:29,778 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:46:29,780 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:46:30,217 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:46:30,652 [279] [DEBUG] [app] Starting request: urn:request:c6f0cebf-bf86-48c9-8398-8186c2d7e08f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:30,652 [278] [DEBUG] [app] Starting request: urn:request:e93d097c-c7f8-417f-99ad-a1ad9d011f56 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [284] [DEBUG] [app] Starting request: urn:request:f0f76991-6656-422f-a3a2-478c2ccaa378 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [292] [DEBUG] [app] Starting request: urn:request:8e15b403-0488-41e4-a66e-791d0fe36aef (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [284] [DEBUG] [app] Ending request: urn:request:f0f76991-6656-422f-a3a2-478c2ccaa378 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f0f76991-6656-422f-a3a2-478c2ccaa378', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [292] [DEBUG] [app] Ending request: urn:request:8e15b403-0488-41e4-a66e-791d0fe36aef (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8e15b403-0488-41e4-a66e-791d0fe36aef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:46:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:30,659 [278] [DEBUG] [app] Starting request: urn:request:eec65674-3f9c-4972-bdf0-194d18879aa5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [278] [DEBUG] [app] Ending request: urn:request:eec65674-3f9c-4972-bdf0-194d18879aa5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eec65674-3f9c-4972-bdf0-194d18879aa5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [281] [DEBUG] [app] Starting request: urn:request:98dd6eed-bd53-46f7-86ff-8fe95ca4b48a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:30,660 [281] [DEBUG] [app] Ending request: urn:request:98dd6eed-bd53-46f7-86ff-8fe95ca4b48a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:98dd6eed-bd53-46f7-86ff-8fe95ca4b48a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:30,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:30,676 [279] [DEBUG] [app] Ending request: urn:request:c6f0cebf-bf86-48c9-8398-8186c2d7e08f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c6f0cebf-bf86-48c9-8398-8186c2d7e08f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:30,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:30,677 [278] [DEBUG] [app] Ending request: urn:request:e93d097c-c7f8-417f-99ad-a1ad9d011f56 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e93d097c-c7f8-417f-99ad-a1ad9d011f56', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:30,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:46:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.025)
gunicorn-web stdout | 2024-04-22 03:46:30,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:46:31,665 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:46:32,945 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:46:33,296 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:46:33,414 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:46:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:43.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 03:46:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:43 UTC)" (scheduled at 2024-04-22 03:46:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 33, 760327), True, datetime.datetime(2024, 4, 22, 3, 46, 33, 760327), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:46:34,377 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:46:34,381 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:46:34,384 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:46:34,469 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:46:35,639 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:46:35,829 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:56.873109+00:00 (in 21.000820 seconds)
securityworker stdout | 2024-04-22 03:46:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:05 UTC)" (scheduled at 2024-04-22 03:46:35.871852+00:00)
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:05 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:46:35,989 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:46:36,821 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:46:38,228 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:46:38,270 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:46:38,730 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:46:38,791 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:41.564959+00:00 (in 1.997532 seconds)
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:39 UTC)" (scheduled at 2024-04-22 03:46:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:46:39,943 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:46:40,596 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:46:40,606 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:46:40,608 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:46:40,617 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:46:40,620 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:46:40,624 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:46:40,627 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:46:40,630 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:46:40,635 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:46:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:46:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:11.264267+00:00 (in 29.999525 seconds)
autopruneworker stdout | 2024-04-22 03:46:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:11 UTC)" (scheduled at 2024-04-22 03:46:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:46:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757541271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:46:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:46:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:46:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:53.566665+00:00 (in 12.001226 seconds)
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:41 UTC)" (scheduled at 2024-04-22 03:46:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:46:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 41, 565696), True, datetime.datetime(2024, 4, 22, 3, 46, 41, 565696), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:46:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:46:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:46:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:22.058978+00:00 (in 39.001324 seconds)
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:43 UTC)" (scheduled at 2024-04-22 03:46:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:46:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 43, 57954), True, datetime.datetime(2024, 4, 22, 3, 46, 43, 57954), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:46:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:46:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:46:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:53.759375+00:00 (in 9.999442 seconds)
notificationworker stdout | 2024-04-22 03:46:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:53 UTC)" (scheduled at 2024-04-22 03:46:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 43, 760384), True, datetime.datetime(2024, 4, 22, 3, 46, 43, 760384), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:46:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:46:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:14.952062+00:00 (in 29.999556 seconds)
gcworker stdout | 2024-04-22 03:46:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:14 UTC)" (scheduled at 2024-04-22 03:46:44.952062+00:00)
gcworker stdout | 2024-04-22 03:46:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548004952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:46:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:46:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:46:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:46:45,653 [279] [DEBUG] [app] Starting request: urn:request:1458ec43-a4de-4d68-ba6c-4e4207ac09fb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:45,653 [282] [DEBUG] [app] Starting request: urn:request:be27dfee-ca88-4862-8efa-056ce0a1b393 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [284] [DEBUG] [app] Starting request: urn:request:92aefbb1-c8aa-42c0-9497-ea8dad9568f4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [292] [DEBUG] [app] Starting request: urn:request:5fef8ad1-45e7-438c-94e6-42bea7ab3bb8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [284] [DEBUG] [app] Ending request: urn:request:92aefbb1-c8aa-42c0-9497-ea8dad9568f4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:92aefbb1-c8aa-42c0-9497-ea8dad9568f4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [292] [DEBUG] [app] Ending request: urn:request:5fef8ad1-45e7-438c-94e6-42bea7ab3bb8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5fef8ad1-45e7-438c-94e6-42bea7ab3bb8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:46:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:45,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:45,660 [281] [DEBUG] [app] Starting request: urn:request:9fb87a74-7920-4dd2-ba3d-d0ca47fc884d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:45,661 [281] [DEBUG] [app] Ending request: urn:request:9fb87a74-7920-4dd2-ba3d-d0ca47fc884d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9fb87a74-7920-4dd2-ba3d-d0ca47fc884d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:45,662 [278] [DEBUG] [app] Starting request: urn:request:81fa16b3-a215-4ef5-95ab-ac13337896ed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:45,662 [278] [DEBUG] [app] Ending request: urn:request:81fa16b3-a215-4ef5-95ab-ac13337896ed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:81fa16b3-a215-4ef5-95ab-ac13337896ed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:45,663 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:45,663 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:45,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:45,677 [279] [DEBUG] [app] Ending request: urn:request:1458ec43-a4de-4d68-ba6c-4e4207ac09fb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1458ec43-a4de-4d68-ba6c-4e4207ac09fb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:45,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:45,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:46:45,678 [282] [DEBUG] [app] Ending request: urn:request:be27dfee-ca88-4862-8efa-056ce0a1b393 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be27dfee-ca88-4862-8efa-056ce0a1b393', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:45,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:45,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:46:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:46:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:17.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 03:46:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:17 UTC)" (scheduled at 2024-04-22 03:46:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:46:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 46, 47, 53202), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:46:47,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:46:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:46:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:46:49,117 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:46:50,631 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:46:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:46:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:06.552482+00:00 (in 14.996509 seconds)
repositorygcworker stdout | 2024-04-22 03:46:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:51 UTC)" (scheduled at 2024-04-22 03:46:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:46:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:46:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), True, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:46:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), True, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:46:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:46:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:46:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:46:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:39.566970+00:00 (in 45.999832 seconds)
exportactionlogsworker stdout | 2024-04-22 03:46:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:53 UTC)" (scheduled at 2024-04-22 03:46:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:46:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:46:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), True, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:46:53,581 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), True, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:46:53,583 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:46:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:03.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 03:46:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:03 UTC)" (scheduled at 2024-04-22 03:46:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 53, 760320), True, datetime.datetime(2024, 4, 22, 3, 46, 53, 760320), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:46:54,207 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:46:55,825 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:46:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:05.871852+00:00 (in 8.998293 seconds)
securityworker stdout | 2024-04-22 03:46:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:26 UTC)" (scheduled at 2024-04-22 03:46:56.873109+00:00)
securityworker stdout | 2024-04-22 03:46:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:46:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:46:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 41, 56, 881607), 1, 2])
securityworker stdout | 2024-04-22 03:46:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:56,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 41, 56, 881607), 1, 2])
securityworker stdout | 2024-04-22 03:46:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:46:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:46:57,278 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:46:59,214 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:46:59,218 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:46:59,769 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:46:59,778 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:46:59,781 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:46:59,785 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:46:59,788 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:47:00,255 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:47:00,652 [279] [DEBUG] [app] Starting request: urn:request:5a02534b-be00-49f2-8ce2-7b37d97ab382 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:00,653 [282] [DEBUG] [app] Starting request: urn:request:9bb687dc-df8b-4821-8792-2ccdd68862c3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [284] [DEBUG] [app] Starting request: urn:request:806a84c1-1051-454f-a0f7-ef45dc8af769 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [292] [DEBUG] [app] Starting request: urn:request:24b200b2-2255-49b8-949b-a7728681f62a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [292] [DEBUG] [app] Ending request: urn:request:24b200b2-2255-49b8-949b-a7728681f62a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:24b200b2-2255-49b8-949b-a7728681f62a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [284] [DEBUG] [app] Ending request: urn:request:806a84c1-1051-454f-a0f7-ef45dc8af769 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:806a84c1-1051-454f-a0f7-ef45dc8af769', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:47:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:47:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:00,660 [278] [DEBUG] [app] Starting request: urn:request:5435742e-20f6-4fcd-8f51-7c2382914047 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:00,660 [281] [DEBUG] [app] Starting request: urn:request:a9cb6da0-b491-405a-a29b-ac9f6623d54b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:00,660 [281] [DEBUG] [app] Ending request: urn:request:a9cb6da0-b491-405a-a29b-ac9f6623d54b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a9cb6da0-b491-405a-a29b-ac9f6623d54b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:00,660 [278] [DEBUG] [app] Ending request: urn:request:5435742e-20f6-4fcd-8f51-7c2382914047 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5435742e-20f6-4fcd-8f51-7c2382914047', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:47:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:00,676 [282] [DEBUG] [app] Ending request: urn:request:9bb687dc-df8b-4821-8792-2ccdd68862c3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9bb687dc-df8b-4821-8792-2ccdd68862c3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:00,676 [279] [DEBUG] [app] Ending request: urn:request:5a02534b-be00-49f2-8ce2-7b37d97ab382 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5a02534b-be00-49f2-8ce2-7b37d97ab382', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:47:00,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:47:01,681 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:16.552337+00:00 (in 13.995619 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:02 UTC)" (scheduled at 2024-04-22 03:47:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:47:02,955 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:47:03,333 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:47:03,450 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:47:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:13.759375+00:00 (in 9.999517 seconds)
notificationworker stdout | 2024-04-22 03:47:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:13 UTC)" (scheduled at 2024-04-22 03:47:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 3, 760176), True, datetime.datetime(2024, 4, 22, 3, 47, 3, 760176), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:03,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:47:04,385 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:47:04,388 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:47:04,393 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:47:04,505 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:47:05,675 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:47:05,866 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:26.873109+00:00 (in 21.000793 seconds)
securityworker stdout | 2024-04-22 03:47:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:35 UTC)" (scheduled at 2024-04-22 03:47:05.871852+00:00)
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:35 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:47:06,025 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:47:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:47:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:13.555667+00:00 (in 7.002675 seconds)
repositorygcworker stdout | 2024-04-22 03:47:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:06 UTC)" (scheduled at 2024-04-22 03:47:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:47:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:47:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 6, 553402), True, datetime.datetime(2024, 4, 22, 3, 47, 6, 553402), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:47:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:47:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:47:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:47:06,858 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:47:08,264 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:47:08,305 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:47:08,770 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:47:08,798 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:47:09,979 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:47:10,610 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:47:10,615 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:47:10,622 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:47:10,625 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:47:10,630 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:47:10,635 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:47:10,638 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:47:10,641 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:47:10,646 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:47:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:47:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:41.264267+00:00 (in 29.999568 seconds)
autopruneworker stdout | 2024-04-22 03:47:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:41 UTC)" (scheduled at 2024-04-22 03:47:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:47:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757571271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:47:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:47:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:47:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:47:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:06.552482+00:00 (in 52.996302 seconds)
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:13 UTC)" (scheduled at 2024-04-22 03:47:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:47:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:19.762424+00:00 (in 6.002523 seconds)
notificationworker stdout | 2024-04-22 03:47:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:23 UTC)" (scheduled at 2024-04-22 03:47:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 13, 760328), True, datetime.datetime(2024, 4, 22, 3, 47, 13, 760328), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:47:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:47:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:44.952062+00:00 (in 29.999557 seconds)
gcworker stdout | 2024-04-22 03:47:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:44 UTC)" (scheduled at 2024-04-22 03:47:14.952062+00:00)
gcworker stdout | 2024-04-22 03:47:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548034952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:47:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:47:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:47:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:47:15,652 [281] [DEBUG] [app] Starting request: urn:request:4e16ef8e-6373-4ba7-9813-c89c7ba9fad5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:15,652 [278] [DEBUG] [app] Starting request: urn:request:47949560-5496-4b72-a00a-2cdda75118a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [288] [DEBUG] [app] Starting request: urn:request:6e34c045-0d56-414a-9898-b8f155b237b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [292] [DEBUG] [app] Starting request: urn:request:7ecbfad7-110a-43e6-b3ec-fb17ec90329c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [288] [DEBUG] [app] Ending request: urn:request:6e34c045-0d56-414a-9898-b8f155b237b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6e34c045-0d56-414a-9898-b8f155b237b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [292] [DEBUG] [app] Ending request: urn:request:7ecbfad7-110a-43e6-b3ec-fb17ec90329c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7ecbfad7-110a-43e6-b3ec-fb17ec90329c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:47:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:15,660 [282] [DEBUG] [app] Starting request: urn:request:e45bf7ec-613e-4aef-8834-5e63532d33b3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [279] [DEBUG] [app] Starting request: urn:request:404a1405-6635-4712-bd89-68ced5ca493c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [282] [DEBUG] [app] Ending request: urn:request:e45bf7ec-613e-4aef-8834-5e63532d33b3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e45bf7ec-613e-4aef-8834-5e63532d33b3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [279] [DEBUG] [app] Ending request: urn:request:404a1405-6635-4712-bd89-68ced5ca493c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:404a1405-6635-4712-bd89-68ced5ca493c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:47:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:15,676 [278] [DEBUG] [app] Ending request: urn:request:47949560-5496-4b72-a00a-2cdda75118a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:47949560-5496-4b72-a00a-2cdda75118a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:47:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:47:15,676 [281] [DEBUG] [app] Ending request: urn:request:4e16ef8e-6373-4ba7-9813-c89c7ba9fad5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4e16ef8e-6373-4ba7-9813-c89c7ba9fad5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:21.555879+00:00 (in 5.002984 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:16 UTC)" (scheduled at 2024-04-22 03:47:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 16, 553401), True, datetime.datetime(2024, 4, 22, 3, 47, 16, 553401), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:47:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:47:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:47.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 03:47:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:47 UTC)" (scheduled at 2024-04-22 03:47:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:47:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 47, 17, 53105), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:47:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:47:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:47:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:47:19,153 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:47:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:23.759375+00:00 (in 3.996421 seconds)
notificationworker stdout | 2024-04-22 03:47:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:19 UTC)" (scheduled at 2024-04-22 03:47:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:47:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:47:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:47:20,668 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:02.556208+00:00 (in 40.999756 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:21 UTC)" (scheduled at 2024-04-22 03:47:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,568 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), True, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,571 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), True, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,573 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,573 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:38.058708+00:00 (in 15.999231 seconds)
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:22 UTC)" (scheduled at 2024-04-22 03:47:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:47:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:33.759375+00:00 (in 9.999510 seconds)
notificationworker stdout | 2024-04-22 03:47:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:33 UTC)" (scheduled at 2024-04-22 03:47:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 23, 760164), True, datetime.datetime(2024, 4, 22, 3, 47, 23, 760164), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:47:24,243 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:24.361582+00:00 (in 59.999524 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:24 UTC)" (scheduled at 2024-04-22 03:47:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:47:25,861 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:35.871852+00:00 (in 8.998302 seconds)
securityworker stdout | 2024-04-22 03:47:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:56 UTC)" (scheduled at 2024-04-22 03:47:26.873109+00:00)
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:47:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:47:26,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:47:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 42, 26, 880384), 1, 2])
securityworker stdout | 2024-04-22 03:47:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 42, 26, 880384), 1, 2])
securityworker stdout | 2024-04-22 03:47:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:47:27,316 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:47:29,250 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:47:29,255 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:47:29,777 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:47:29,785 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:47:29,789 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:47:29,794 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:47:29,796 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:47:30,291 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:47:30,652 [281] [DEBUG] [app] Starting request: urn:request:eacb7397-71f6-4b0c-acc1-aa1836c0356f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:30,652 [279] [DEBUG] [app] Starting request: urn:request:1d28384f-913a-4328-b620-eeec19a91ef4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [284] [DEBUG] [app] Starting request: urn:request:30130bc7-f11e-4efe-8098-abd6454093a8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [292] [DEBUG] [app] Starting request: urn:request:47fffd85-0d9c-45d6-bf81-b9c6c3c08362 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [284] [DEBUG] [app] Ending request: urn:request:30130bc7-f11e-4efe-8098-abd6454093a8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:30130bc7-f11e-4efe-8098-abd6454093a8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [292] [DEBUG] [app] Ending request: urn:request:47fffd85-0d9c-45d6-bf81-b9c6c3c08362 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47fffd85-0d9c-45d6-bf81-b9c6c3c08362', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:47:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:47:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [DEBUG] [app] Starting request: urn:request:ad7e8665-f317-4c7d-98ab-eee55d2c9c11 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [DEBUG] [app] Ending request: urn:request:ad7e8665-f317-4c7d-98ab-eee55d2c9c11 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ad7e8665-f317-4c7d-98ab-eee55d2c9c11', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:30,661 [278] [DEBUG] [app] Starting request: urn:request:342be0fe-6521-4486-9151-2112526f8aff (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:30,662 [278] [DEBUG] [app] Ending request: urn:request:342be0fe-6521-4486-9151-2112526f8aff (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:342be0fe-6521-4486-9151-2112526f8aff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:30,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:47:30,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,663 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:30,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:30,676 [281] [DEBUG] [app] Ending request: urn:request:eacb7397-71f6-4b0c-acc1-aa1836c0356f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:eacb7397-71f6-4b0c-acc1-aa1836c0356f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:47:30,678 [279] [DEBUG] [app] Ending request: urn:request:1d28384f-913a-4328-b620-eeec19a91ef4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1d28384f-913a-4328-b620-eeec19a91ef4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:30,678 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:47:30,678 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:47:31,717 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:47:32,991 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:47:33,369 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:47:33,458 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:47:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:43.759375+00:00 (in 9.999453 seconds)
notificationworker stdout | 2024-04-22 03:47:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:43 UTC)" (scheduled at 2024-04-22 03:47:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 33, 760256), True, datetime.datetime(2024, 4, 22, 3, 47, 33, 760256), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:47:34,394 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:47:34,397 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:47:34,401 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:47:34,541 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:47:35,712 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:56.873109+00:00 (in 21.000747 seconds)
securityworker stdout | 2024-04-22 03:47:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:05 UTC)" (scheduled at 2024-04-22 03:47:35.871852+00:00)
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:05 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:47:35,902 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:47:36,056 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:47:36,894 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 03:47:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:47:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:43.057186+00:00 (in 4.998026 seconds)
namespacegcworker stdout | 2024-04-22 03:47:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:38 UTC)" (scheduled at 2024-04-22 03:47:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:47:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:47:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), True, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:47:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), True, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:47:38,076 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:47:38,076 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:47:38,301 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:47:38,342 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:47:38,807 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:47:38,815 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:41.564959+00:00 (in 1.997521 seconds)
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:39 UTC)" (scheduled at 2024-04-22 03:47:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:47:40,015 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:47:40,618 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:47:40,623 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:47:40,634 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:47:40,636 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:47:40,639 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:47:40,645 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:47:40,650 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:47:40,653 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:47:40,655 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:47:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:47:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:11.264267+00:00 (in 29.999535 seconds)
autopruneworker stdout | 2024-04-22 03:47:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:11 UTC)" (scheduled at 2024-04-22 03:47:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:47:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757601271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:47:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:47:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:47:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:39.566970+00:00 (in 58.001535 seconds)
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:41 UTC)" (scheduled at 2024-04-22 03:47:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:47:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 41, 565686), True, datetime.datetime(2024, 4, 22, 3, 47, 41, 565686), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:47:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:47:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:47:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:47:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:47:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:22.058978+00:00 (in 39.001107 seconds)
namespacegcworker stdout | 2024-04-22 03:47:43,058 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:43 UTC)" (scheduled at 2024-04-22 03:47:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:47:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:47:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 43, 58384), True, datetime.datetime(2024, 4, 22, 3, 47, 43, 58384), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:47:43,070 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:47:43,070 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:47:43,070 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:47:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:43,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:53.759375+00:00 (in 9.999388 seconds)
notificationworker stdout | 2024-04-22 03:47:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:53 UTC)" (scheduled at 2024-04-22 03:47:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 43, 760312), True, datetime.datetime(2024, 4, 22, 3, 47, 43, 760312), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:47:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:47:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:14.952062+00:00 (in 29.999531 seconds)
gcworker stdout | 2024-04-22 03:47:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:14 UTC)" (scheduled at 2024-04-22 03:47:44.952062+00:00)
gcworker stdout | 2024-04-22 03:47:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548064952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:47:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:47:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:47:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:47:45,653 [281] [DEBUG] [app] Starting request: urn:request:f0380549-dbab-43ef-8137-8cc7a17d96af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:45,653 [279] [DEBUG] [app] Starting request: urn:request:601c04e0-5c0f-43ca-bcd5-c75961e96399 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:45,656 [284] [DEBUG] [app] Starting request: urn:request:d825c688-f3fc-488c-b1fd-e0b08b2c4cfe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:45,656 [292] [DEBUG] [app] Starting request: urn:request:eb97abd2-6ad0-4f44-8ba3-77b07b19d284 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [284] [DEBUG] [app] Ending request: urn:request:d825c688-f3fc-488c-b1fd-e0b08b2c4cfe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d825c688-f3fc-488c-b1fd-e0b08b2c4cfe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [292] [DEBUG] [app] Ending request: urn:request:eb97abd2-6ad0-4f44-8ba3-77b07b19d284 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eb97abd2-6ad0-4f44-8ba3-77b07b19d284', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:47:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:45,660 [279] [DEBUG] [app] Starting request: urn:request:46b0fccd-d653-496b-8631-448a9895254c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:45,660 [279] [DEBUG] [app] Ending request: urn:request:46b0fccd-d653-496b-8631-448a9895254c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:46b0fccd-d653-496b-8631-448a9895254c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:45,661 [278] [DEBUG] [app] Starting request: urn:request:43b3faae-a950-40f2-b58c-a7ff03f1042f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:47:45,661 [278] [DEBUG] [app] Ending request: urn:request:43b3faae-a950-40f2-b58c-a7ff03f1042f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:43b3faae-a950-40f2-b58c-a7ff03f1042f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:47:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:45,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:45,676 [279] [DEBUG] [app] Ending request: urn:request:601c04e0-5c0f-43ca-bcd5-c75961e96399 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:601c04e0-5c0f-43ca-bcd5-c75961e96399', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:45,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:45,676 [281] [DEBUG] [app] Ending request: urn:request:f0380549-dbab-43ef-8137-8cc7a17d96af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0380549-dbab-43ef-8137-8cc7a17d96af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:45,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:45,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:47:45,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:47:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:47:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:17.052354+00:00 (in 29.999494 seconds)
buildlogsarchiver stdout | 2024-04-22 03:47:47,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:17 UTC)" (scheduled at 2024-04-22 03:47:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:47:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 47, 47, 53066), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:47:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:47:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:47:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:47:49,189 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:47:50,677 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:47:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:03.759375+00:00 (in 9.999444 seconds)
notificationworker stdout | 2024-04-22 03:47:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:03 UTC)" (scheduled at 2024-04-22 03:47:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 53, 760403), True, datetime.datetime(2024, 4, 22, 3, 47, 53, 760403), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:47:54,279 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:47:55,898 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:05.871852+00:00 (in 8.998268 seconds)
securityworker stdout | 2024-04-22 03:47:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:26 UTC)" (scheduled at 2024-04-22 03:47:56.873109+00:00)
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:47:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:47:56,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:47:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 42, 56, 880378), 1, 2])
securityworker stdout | 2024-04-22 03:47:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 42, 56, 880378), 1, 2])
securityworker stdout | 2024-04-22 03:47:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:47:57,352 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:47:59,286 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:47:59,291 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:47:59,785 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:47:59,794 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:47:59,797 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:47:59,803 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:47:59,805 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:48:00,329 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:48:00,653 [282] [DEBUG] [app] Starting request: urn:request:5eddfe73-dcc4-4c5e-8b16-60ee886eff7c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:00,653 [281] [DEBUG] [app] Starting request: urn:request:5e852d95-0bb4-4632-8061-3a79e50a076a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [284] [DEBUG] [app] Starting request: urn:request:b1b61d9c-87f1-4091-a5a8-2135e415e987 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [291] [DEBUG] [app] Starting request: urn:request:0d4143e7-6ca7-4654-aeb6-d1b01ac3db82 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [284] [DEBUG] [app] Ending request: urn:request:b1b61d9c-87f1-4091-a5a8-2135e415e987 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b1b61d9c-87f1-4091-a5a8-2135e415e987', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [291] [DEBUG] [app] Ending request: urn:request:0d4143e7-6ca7-4654-aeb6-d1b01ac3db82 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0d4143e7-6ca7-4654-aeb6-d1b01ac3db82', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:48:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:00,661 [278] [DEBUG] [app] Starting request: urn:request:157d4714-f1a4-4284-bf30-a884014df3b6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:00,661 [281] [DEBUG] [app] Starting request: urn:request:d205c99b-8aa5-40ed-b085-8e68e1513869 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:00,661 [278] [DEBUG] [app] Ending request: urn:request:157d4714-f1a4-4284-bf30-a884014df3b6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:157d4714-f1a4-4284-bf30-a884014df3b6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:00,661 [281] [DEBUG] [app] Ending request: urn:request:d205c99b-8aa5-40ed-b085-8e68e1513869 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d205c99b-8aa5-40ed-b085-8e68e1513869', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:48:00,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:00,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:00,677 [282] [DEBUG] [app] Ending request: urn:request:5eddfe73-dcc4-4c5e-8b16-60ee886eff7c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5eddfe73-dcc4-4c5e-8b16-60ee886eff7c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:00,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:00,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:48:00,678 [281] [DEBUG] [app] Ending request: urn:request:5e852d95-0bb4-4632-8061-3a79e50a076a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5e852d95-0bb4-4632-8061-3a79e50a076a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:48:00,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:00,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:48:01,752 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:16.552337+00:00 (in 13.995636 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:02 UTC)" (scheduled at 2024-04-22 03:48:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:48:03,027 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:48:03,405 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:48:03,495 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:48:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:13.759375+00:00 (in 9.999435 seconds)
notificationworker stdout | 2024-04-22 03:48:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:13 UTC)" (scheduled at 2024-04-22 03:48:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 3, 760232), True, datetime.datetime(2024, 4, 22, 3, 48, 3, 760232), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:48:04,403 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:48:04,409 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:48:04,411 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:48:04,578 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:48:05,748 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:26.873109+00:00 (in 21.000782 seconds)
securityworker stdout | 2024-04-22 03:48:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:35 UTC)" (scheduled at 2024-04-22 03:48:05.871852+00:00)
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:35 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:48:05,938 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:48:06,064 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:48:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:48:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:13.555667+00:00 (in 7.002705 seconds)
repositorygcworker stdout | 2024-04-22 03:48:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:06 UTC)" (scheduled at 2024-04-22 03:48:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:48:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:48:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 6, 553370), True, datetime.datetime(2024, 4, 22, 3, 48, 6, 553370), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:48:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:48:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:48:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:48:06,931 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:48:08,339 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:48:08,378 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:48:08,822 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:48:08,844 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:48:10,051 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:48:10,628 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:48:10,636 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:48:10,643 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:48:10,646 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:48:10,649 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:48:10,653 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:48:10,660 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:48:10,662 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:48:10,665 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:48:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:48:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:48:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:41 UTC)" (scheduled at 2024-04-22 03:48:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:48:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757631271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:48:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:48:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:48:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:48:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:06.552482+00:00 (in 52.996350 seconds)
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:13 UTC)" (scheduled at 2024-04-22 03:48:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:19.762160+00:00 (in 6.002295 seconds)
notificationworker stdout | 2024-04-22 03:48:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:23 UTC)" (scheduled at 2024-04-22 03:48:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 13, 760265), True, datetime.datetime(2024, 4, 22, 3, 48, 13, 760265), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:48:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:48:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:44.952062+00:00 (in 29.999477 seconds)
gcworker stdout | 2024-04-22 03:48:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:44 UTC)" (scheduled at 2024-04-22 03:48:14.952062+00:00)
gcworker stdout | 2024-04-22 03:48:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548094953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:48:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:48:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:48:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:48:15,653 [278] [DEBUG] [app] Starting request: urn:request:2e250ffd-4434-4cc1-8b5c-aed77f540f04 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:15,653 [282] [DEBUG] [app] Starting request: urn:request:f2034f7d-59b2-41b4-89c0-5b77327d0c40 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:15,656 [291] [DEBUG] [app] Starting request: urn:request:c2e7a474-fa38-42b5-979c-1b4803b29625 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:15,656 [291] [DEBUG] [app] Ending request: urn:request:c2e7a474-fa38-42b5-979c-1b4803b29625 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c2e7a474-fa38-42b5-979c-1b4803b29625', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:15,656 [284] [DEBUG] [app] Starting request: urn:request:f50c07a4-5dfb-48e5-bca7-72c03cf1b949 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:48:15,657 [284] [DEBUG] [app] Ending request: urn:request:f50c07a4-5dfb-48e5-bca7-72c03cf1b949 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f50c07a4-5dfb-48e5-bca7-72c03cf1b949', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:48:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:48:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:15,660 [281] [DEBUG] [app] Starting request: urn:request:d31d1a81-a89e-4e5b-bd7e-541f90c2e3f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:15,660 [281] [DEBUG] [app] Ending request: urn:request:d31d1a81-a89e-4e5b-bd7e-541f90c2e3f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d31d1a81-a89e-4e5b-bd7e-541f90c2e3f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:15,660 [278] [DEBUG] [app] Starting request: urn:request:34a2aedf-bb2f-4a8a-9b47-43a530f61621 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:48:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:15,660 [278] [DEBUG] [app] Ending request: urn:request:34a2aedf-bb2f-4a8a-9b47-43a530f61621 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:34a2aedf-bb2f-4a8a-9b47-43a530f61621', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 03:48:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:15,676 [282] [DEBUG] [app] Ending request: urn:request:f2034f7d-59b2-41b4-89c0-5b77327d0c40 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f2034f7d-59b2-41b4-89c0-5b77327d0c40', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:48:15,676 [278] [DEBUG] [app] Ending request: urn:request:2e250ffd-4434-4cc1-8b5c-aed77f540f04 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2e250ffd-4434-4cc1-8b5c-aed77f540f04', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:02.556208+00:00 (in 46.003311 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:16 UTC)" (scheduled at 2024-04-22 03:48:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 16, 553370), True, datetime.datetime(2024, 4, 22, 3, 48, 16, 553370), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:48:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:48:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:47.052354+00:00 (in 29.999497 seconds)
buildlogsarchiver stdout | 2024-04-22 03:48:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:47 UTC)" (scheduled at 2024-04-22 03:48:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:48:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 48, 17, 53052), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:48:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:48:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:48:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:48:19,225 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:48:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:23.759375+00:00 (in 3.996650 seconds)
notificationworker stdout | 2024-04-22 03:48:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:53:19 UTC)" (scheduled at 2024-04-22 03:48:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:48:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 'notification/%'])
notificationworker stdout | 2024-04-22 03:48:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:19 UTC)" (scheduled at 2024-04-22 03:48:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:48:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:48:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), True, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:48:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), True, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 'notification/%'])
notificationworker stdout | 2024-04-22 03:48:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:53:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:48:20,712 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:43.057186+00:00 (in 20.997620 seconds)
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:22 UTC)" (scheduled at 2024-04-22 03:48:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:48:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:33.759375+00:00 (in 9.999419 seconds)
notificationworker stdout | 2024-04-22 03:48:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:33 UTC)" (scheduled at 2024-04-22 03:48:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 23, 760429), True, datetime.datetime(2024, 4, 22, 3, 48, 23, 760429), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:48:24,304 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:24.361582+00:00 (in 59.999476 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:24 UTC)" (scheduled at 2024-04-22 03:48:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:48:25,934 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:35.871852+00:00 (in 8.998263 seconds)
securityworker stdout | 2024-04-22 03:48:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:56 UTC)" (scheduled at 2024-04-22 03:48:26.873109+00:00)
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:48:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:26,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:48:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 43, 26, 880028), 1, 2])
securityworker stdout | 2024-04-22 03:48:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 43, 26, 880028), 1, 2])
securityworker stdout | 2024-04-22 03:48:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:48:27,388 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:48:29,299 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:48:29,312 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:48:29,793 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:48:29,800 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:48:29,803 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:48:29,810 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:48:29,813 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:48:30,364 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:48:30,653 [278] [DEBUG] [app] Starting request: urn:request:db7a7abc-35d1-4881-9b91-98744d15c049 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:30,653 [282] [DEBUG] [app] Starting request: urn:request:924dd61e-0380-47eb-8231-440582a28195 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:30,656 [284] [DEBUG] [app] Starting request: urn:request:92de5366-3a58-4e1e-a50f-9893eb86a011 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:30,656 [290] [DEBUG] [app] Starting request: urn:request:87464076-8883-49d6-b3f4-8d428dc89111 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [284] [DEBUG] [app] Ending request: urn:request:92de5366-3a58-4e1e-a50f-9893eb86a011 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:92de5366-3a58-4e1e-a50f-9893eb86a011', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [290] [DEBUG] [app] Ending request: urn:request:87464076-8883-49d6-b3f4-8d428dc89111 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:87464076-8883-49d6-b3f4-8d428dc89111', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:48:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:30,659 [278] [DEBUG] [app] Starting request: urn:request:e80e4460-8dff-4507-ac5e-2bda96df3fa7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:30,660 [278] [DEBUG] [app] Ending request: urn:request:e80e4460-8dff-4507-ac5e-2bda96df3fa7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e80e4460-8dff-4507-ac5e-2bda96df3fa7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:48:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:30,660 [281] [DEBUG] [app] Starting request: urn:request:b7cc773a-1c23-4ccb-9356-7d5e3fa52052 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:30,660 [281] [DEBUG] [app] Ending request: urn:request:b7cc773a-1c23-4ccb-9356-7d5e3fa52052 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b7cc773a-1c23-4ccb-9356-7d5e3fa52052', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:48:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:30,675 [278] [DEBUG] [app] Ending request: urn:request:db7a7abc-35d1-4881-9b91-98744d15c049 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:db7a7abc-35d1-4881-9b91-98744d15c049', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:30,675 [282] [DEBUG] [app] Ending request: urn:request:924dd61e-0380-47eb-8231-440582a28195 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:924dd61e-0380-47eb-8231-440582a28195', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:48:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:48:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:48:31,788 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:48:33,034 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:48:33,441 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:48:33,531 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:48:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:43.759375+00:00 (in 9.999541 seconds)
notificationworker stdout | 2024-04-22 03:48:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:43 UTC)" (scheduled at 2024-04-22 03:48:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 33, 760130), True, datetime.datetime(2024, 4, 22, 3, 48, 33, 760130), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:48:34,411 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:48:34,415 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:48:34,419 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:48:34,585 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:48:35,785 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:56.873109+00:00 (in 21.000716 seconds)
securityworker stdout | 2024-04-22 03:48:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:05 UTC)" (scheduled at 2024-04-22 03:48:35.871852+00:00)
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:35,874 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:05 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:48:35,975 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:48:36,079 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:48:36,967 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:48:38,364 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:48:38,416 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:48:38,839 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:48:38,880 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:41.564959+00:00 (in 1.997446 seconds)
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:39 UTC)" (scheduled at 2024-04-22 03:48:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:48:40,087 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:48:40,639 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:48:40,649 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:48:40,652 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:48:40,656 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:48:40,659 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:48:40,663 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:48:40,670 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:48:40,672 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:48:40,676 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:48:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:48:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:11.264267+00:00 (in 29.999551 seconds)
autopruneworker stdout | 2024-04-22 03:48:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:11 UTC)" (scheduled at 2024-04-22 03:48:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:48:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757661271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:48:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:48:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:48:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:39.566970+00:00 (in 58.001516 seconds)
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:41 UTC)" (scheduled at 2024-04-22 03:48:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:48:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 41, 565741), True, datetime.datetime(2024, 4, 22, 3, 48, 41, 565741), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:48:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:48:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:48:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:48:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:48:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:22.058978+00:00 (in 39.001298 seconds)
namespacegcworker stdout | 2024-04-22 03:48:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:43 UTC)" (scheduled at 2024-04-22 03:48:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:48:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:48:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 43, 58132), True, datetime.datetime(2024, 4, 22, 3, 48, 43, 58132), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:48:43,070 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:48:43,070 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:48:43,070 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:53.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 03:48:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:53 UTC)" (scheduled at 2024-04-22 03:48:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 43, 760258), True, datetime.datetime(2024, 4, 22, 3, 48, 43, 760258), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:48:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:48:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:14.952062+00:00 (in 29.999516 seconds)
gcworker stdout | 2024-04-22 03:48:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:14 UTC)" (scheduled at 2024-04-22 03:48:44.952062+00:00)
gcworker stdout | 2024-04-22 03:48:44,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548124953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:48:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:48:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:48:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:48:45,653 [279] [DEBUG] [app] Starting request: urn:request:8d5b8629-1248-415f-8f2c-b87dd743b3bd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:45,653 [281] [DEBUG] [app] Starting request: urn:request:b5778622-20dc-462e-8206-9b344c94f345 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [286] [DEBUG] [app] Starting request: urn:request:7e77e19d-6f7b-4194-9d82-33cc75c4eac8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [292] [DEBUG] [app] Starting request: urn:request:31832175-27fb-45e1-aa1c-c94e1901a379 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [292] [DEBUG] [app] Ending request: urn:request:31832175-27fb-45e1-aa1c-c94e1901a379 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:31832175-27fb-45e1-aa1c-c94e1901a379', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [286] [DEBUG] [app] Ending request: urn:request:7e77e19d-6f7b-4194-9d82-33cc75c4eac8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7e77e19d-6f7b-4194-9d82-33cc75c4eac8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:48:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:48:45,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:45,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:48:45,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:45,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:45,661 [278] [DEBUG] [app] Starting request: urn:request:757f6b9e-0e8c-4d99-a349-617ccb45c5e3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:45,661 [282] [DEBUG] [app] Starting request: urn:request:107e6f28-7619-410c-afb6-cd69bce7309d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:45,662 [278] [DEBUG] [app] Ending request: urn:request:757f6b9e-0e8c-4d99-a349-617ccb45c5e3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:757f6b9e-0e8c-4d99-a349-617ccb45c5e3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:45,662 [282] [DEBUG] [app] Ending request: urn:request:107e6f28-7619-410c-afb6-cd69bce7309d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:107e6f28-7619-410c-afb6-cd69bce7309d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:48:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:45,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:45,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:45,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:45,677 [281] [DEBUG] [app] Ending request: urn:request:b5778622-20dc-462e-8206-9b344c94f345 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5778622-20dc-462e-8206-9b344c94f345', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:45,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:45,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:48:45,678 [279] [DEBUG] [app] Ending request: urn:request:8d5b8629-1248-415f-8f2c-b87dd743b3bd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8d5b8629-1248-415f-8f2c-b87dd743b3bd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:45,678 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
gunicorn-web stdout | 2024-04-22 03:48:45,679 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:48:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:48:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:17.052354+00:00 (in 29.999456 seconds)
buildlogsarchiver stdout | 2024-04-22 03:48:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:17 UTC)" (scheduled at 2024-04-22 03:48:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:48:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 48, 47, 53133), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:48:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:48:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:48:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:48:49,257 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:48:50,748 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:48:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:03.759375+00:00 (in 9.999458 seconds)
notificationworker stdout | 2024-04-22 03:48:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:03 UTC)" (scheduled at 2024-04-22 03:48:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 53, 760213), True, datetime.datetime(2024, 4, 22, 3, 48, 53, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:48:54,311 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:48:55,950 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:05.871852+00:00 (in 8.998288 seconds)
securityworker stdout | 2024-04-22 03:48:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:26 UTC)" (scheduled at 2024-04-22 03:48:56.873109+00:00)
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:48:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:48:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:48:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 43, 56, 880593), 1, 2])
securityworker stdout | 2024-04-22 03:48:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 43, 56, 880593), 1, 2])
securityworker stdout | 2024-04-22 03:48:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:48:57,405 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:48:59,316 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:48:59,347 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:48:59,801 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:48:59,807 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:48:59,811 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:48:59,817 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:48:59,820 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:49:00,401 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:49:00,653 [281] [DEBUG] [app] Starting request: urn:request:38339b4c-8b07-4c5d-9922-cf08de3e06e9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:00,653 [282] [DEBUG] [app] Starting request: urn:request:207f9218-72b6-420b-9b8e-e4b0926a395a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [284] [DEBUG] [app] Starting request: urn:request:5395776f-0e2c-45d1-a4a7-74719bd273e8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [292] [DEBUG] [app] Starting request: urn:request:416aa7d2-d467-426d-9723-84e265f97fa6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [284] [DEBUG] [app] Ending request: urn:request:5395776f-0e2c-45d1-a4a7-74719bd273e8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5395776f-0e2c-45d1-a4a7-74719bd273e8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [292] [DEBUG] [app] Ending request: urn:request:416aa7d2-d467-426d-9723-84e265f97fa6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:416aa7d2-d467-426d-9723-84e265f97fa6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:49:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:49:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:00,659 [281] [DEBUG] [app] Starting request: urn:request:0ab07063-7e78-4dcf-a3de-0314d37027cb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:00,659 [281] [DEBUG] [app] Ending request: urn:request:0ab07063-7e78-4dcf-a3de-0314d37027cb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0ab07063-7e78-4dcf-a3de-0314d37027cb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:49:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:00,660 [279] [DEBUG] [app] Starting request: urn:request:8e457120-6576-42ab-ab20-6b50ab22c328 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:00,660 [279] [DEBUG] [app] Ending request: urn:request:8e457120-6576-42ab-ab20-6b50ab22c328 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8e457120-6576-42ab-ab20-6b50ab22c328', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:49:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:00,675 [281] [DEBUG] [app] Ending request: urn:request:38339b4c-8b07-4c5d-9922-cf08de3e06e9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:38339b4c-8b07-4c5d-9922-cf08de3e06e9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:49:00,675 [282] [DEBUG] [app] Ending request: urn:request:207f9218-72b6-420b-9b8e-e4b0926a395a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:207f9218-72b6-420b-9b8e-e4b0926a395a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:49:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
notificationworker stdout | 2024-04-22 03:49:01,809 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:16.552337+00:00 (in 13.995534 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:02 UTC)" (scheduled at 2024-04-22 03:49:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:49:03,055 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:49:03,466 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:49:03,568 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:49:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:13.759375+00:00 (in 9.999430 seconds)
notificationworker stdout | 2024-04-22 03:49:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:13 UTC)" (scheduled at 2024-04-22 03:49:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 3, 760393), True, datetime.datetime(2024, 4, 22, 3, 49, 3, 760393), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:49:04,419 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:49:04,424 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:49:04,426 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:49:04,614 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:49:05,807 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:26.873109+00:00 (in 21.000739 seconds)
securityworker stdout | 2024-04-22 03:49:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:35 UTC)" (scheduled at 2024-04-22 03:49:05.871852+00:00)
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:35 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:49:06,012 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:49:06,113 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:49:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:49:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:13.555667+00:00 (in 7.002654 seconds)
repositorygcworker stdout | 2024-04-22 03:49:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:06 UTC)" (scheduled at 2024-04-22 03:49:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:49:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:49:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 6, 553398), True, datetime.datetime(2024, 4, 22, 3, 49, 6, 553398), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:49:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:49:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:49:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:49:07,004 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:49:08,400 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:49:08,451 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:49:08,848 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:49:08,888 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:49:10,115 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:49:10,647 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:49:10,660 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:49:10,662 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:49:10,666 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:49:10,668 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:49:10,672 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:49:10,679 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:49:10,682 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:49:10,684 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:49:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:49:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:41.264267+00:00 (in 29.999464 seconds)
autopruneworker stdout | 2024-04-22 03:49:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:41 UTC)" (scheduled at 2024-04-22 03:49:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:49:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757691271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:49:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:49:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:49:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:49:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:06.552482+00:00 (in 52.996331 seconds)
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:13 UTC)" (scheduled at 2024-04-22 03:49:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:49:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:19.762424+00:00 (in 6.002562 seconds)
notificationworker stdout | 2024-04-22 03:49:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:23 UTC)" (scheduled at 2024-04-22 03:49:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 13, 760155), True, datetime.datetime(2024, 4, 22, 3, 49, 13, 760155), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:49:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:49:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:44.952062+00:00 (in 29.999524 seconds)
gcworker stdout | 2024-04-22 03:49:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:44 UTC)" (scheduled at 2024-04-22 03:49:14.952062+00:00)
gcworker stdout | 2024-04-22 03:49:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548154952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:49:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:49:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:49:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:49:15,653 [279] [DEBUG] [app] Starting request: urn:request:1888070c-231f-4cdb-88d7-fb8d7182f1b4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:15,653 [282] [DEBUG] [app] Starting request: urn:request:4099abb7-f022-4e9d-9358-b7831b96243f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:15,657 [284] [DEBUG] [app] Starting request: urn:request:eb3c2c04-d815-46f8-af07-767c6162ac08 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:15,657 [290] [DEBUG] [app] Starting request: urn:request:4d285cfe-0b92-49d4-aa7a-38e937a96ae1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:15,657 [284] [DEBUG] [app] Ending request: urn:request:eb3c2c04-d815-46f8-af07-767c6162ac08 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eb3c2c04-d815-46f8-af07-767c6162ac08', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:15,658 [290] [DEBUG] [app] Ending request: urn:request:4d285cfe-0b92-49d4-aa7a-38e937a96ae1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4d285cfe-0b92-49d4-aa7a-38e937a96ae1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:49:15,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:49:15,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:49:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:15,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:15,660 [281] [DEBUG] [app] Starting request: urn:request:0be07f4d-d569-4ad7-83ac-ed92ea221fdb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [282] [DEBUG] [app] Starting request: urn:request:7cdb4250-bee7-4bb2-94a7-5ec84f81753e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [281] [DEBUG] [app] Ending request: urn:request:0be07f4d-d569-4ad7-83ac-ed92ea221fdb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0be07f4d-d569-4ad7-83ac-ed92ea221fdb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [282] [DEBUG] [app] Ending request: urn:request:7cdb4250-bee7-4bb2-94a7-5ec84f81753e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7cdb4250-bee7-4bb2-94a7-5ec84f81753e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:49:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:15,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:15,676 [282] [DEBUG] [app] Ending request: urn:request:4099abb7-f022-4e9d-9358-b7831b96243f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4099abb7-f022-4e9d-9358-b7831b96243f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:49:15,677 [279] [DEBUG] [app] Ending request: urn:request:1888070c-231f-4cdb-88d7-fb8d7182f1b4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1888070c-231f-4cdb-88d7-fb8d7182f1b4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:15,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:15,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:02.556208+00:00 (in 46.003317 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:16 UTC)" (scheduled at 2024-04-22 03:49:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 16, 553315), True, datetime.datetime(2024, 4, 22, 3, 49, 16, 553315), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:49:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:49:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:47.052354+00:00 (in 29.999510 seconds)
buildlogsarchiver stdout | 2024-04-22 03:49:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:47 UTC)" (scheduled at 2024-04-22 03:49:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:49:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 49, 17, 53036), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:49:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:49:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:49:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:49:19,294 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:49:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:23.759375+00:00 (in 3.996427 seconds)
notificationworker stdout | 2024-04-22 03:49:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:19 UTC)" (scheduled at 2024-04-22 03:49:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:49:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:49:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:49:20,785 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:43.057186+00:00 (in 20.997686 seconds)
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:22 UTC)" (scheduled at 2024-04-22 03:49:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:49:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:33.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 03:49:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:33 UTC)" (scheduled at 2024-04-22 03:49:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 23, 760344), True, datetime.datetime(2024, 4, 22, 3, 49, 23, 760344), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:49:24,337 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:24.361582+00:00 (in 59.999504 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:24 UTC)" (scheduled at 2024-04-22 03:49:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:49:25,986 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:49:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:35.871852+00:00 (in 8.998275 seconds)
securityworker stdout | 2024-04-22 03:49:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:56 UTC)" (scheduled at 2024-04-22 03:49:26.873109+00:00)
securityworker stdout | 2024-04-22 03:49:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:49:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:49:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 44, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 03:49:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 44, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 03:49:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:49:27,440 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:49:29,346 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:49:29,383 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:49:29,810 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:49:29,814 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:49:29,817 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:49:29,824 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:49:29,827 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:49:30,409 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:49:30,653 [281] [DEBUG] [app] Starting request: urn:request:aef5d737-e0d5-433e-a019-589277211520 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:30,653 [278] [DEBUG] [app] Starting request: urn:request:3201d6f4-1672-4a2a-9f5e-d2d3116b4555 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [290] [DEBUG] [app] Starting request: urn:request:4b843d7c-9a1a-426a-bb91-7aa15502f777 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [291] [DEBUG] [app] Starting request: urn:request:9cf422aa-331e-4d2e-b609-0cc3ea16d598 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [290] [DEBUG] [app] Ending request: urn:request:4b843d7c-9a1a-426a-bb91-7aa15502f777 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4b843d7c-9a1a-426a-bb91-7aa15502f777', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [291] [DEBUG] [app] Ending request: urn:request:9cf422aa-331e-4d2e-b609-0cc3ea16d598 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9cf422aa-331e-4d2e-b609-0cc3ea16d598', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:30,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:49:30,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:49:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:30,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:30,661 [282] [DEBUG] [app] Starting request: urn:request:356142a8-b212-49d5-805b-a171fe38e31d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:30,661 [279] [DEBUG] [app] Starting request: urn:request:d1ee2c19-8b3c-4097-8702-4ab42b5413a6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:30,662 [282] [DEBUG] [app] Ending request: urn:request:356142a8-b212-49d5-805b-a171fe38e31d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:356142a8-b212-49d5-805b-a171fe38e31d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:30,662 [279] [DEBUG] [app] Ending request: urn:request:d1ee2c19-8b3c-4097-8702-4ab42b5413a6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d1ee2c19-8b3c-4097-8702-4ab42b5413a6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:30,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:30,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:49:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:30,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:30,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:30,677 [278] [DEBUG] [app] Ending request: urn:request:3201d6f4-1672-4a2a-9f5e-d2d3116b4555 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3201d6f4-1672-4a2a-9f5e-d2d3116b4555', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:30,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:49:30,678 [281] [DEBUG] [app] Ending request: urn:request:aef5d737-e0d5-433e-a019-589277211520 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:aef5d737-e0d5-433e-a019-589277211520', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:30,678 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:49:30,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:49:31,838 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:49:33,092 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:49:33,490 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:49:33,596 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:49:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:43.759375+00:00 (in 9.999462 seconds)
notificationworker stdout | 2024-04-22 03:49:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:43 UTC)" (scheduled at 2024-04-22 03:49:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 33, 760406), True, datetime.datetime(2024, 4, 22, 3, 49, 33, 760406), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:49:34,427 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:49:34,431 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:49:34,433 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:49:34,651 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:49:35,843 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:49:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:56.873109+00:00 (in 21.000731 seconds)
securityworker stdout | 2024-04-22 03:49:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:05 UTC)" (scheduled at 2024-04-22 03:49:35.871852+00:00)
securityworker stdout | 2024-04-22 03:49:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:05 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:49:36,024 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:49:36,122 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:49:37,041 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:49:38,436 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:49:38,472 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:49:38,865 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:49:38,924 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:41.564959+00:00 (in 1.997488 seconds)
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:39 UTC)" (scheduled at 2024-04-22 03:49:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:49:40,145 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:49:40,655 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:49:40,671 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:49:40,673 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:49:40,676 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:49:40,678 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:49:40,681 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:49:40,688 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:49:40,693 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:49:40,695 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:49:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:49:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:11.264267+00:00 (in 29.999526 seconds)
autopruneworker stdout | 2024-04-22 03:49:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:11 UTC)" (scheduled at 2024-04-22 03:49:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:49:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757721272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:49:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:49:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:49:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:39.566970+00:00 (in 58.001501 seconds)
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:41 UTC)" (scheduled at 2024-04-22 03:49:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:49:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 41, 565804), True, datetime.datetime(2024, 4, 22, 3, 49, 41, 565804), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:49:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:49:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:49:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:49:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:49:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:22.058978+00:00 (in 39.001263 seconds)
namespacegcworker stdout | 2024-04-22 03:49:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:43 UTC)" (scheduled at 2024-04-22 03:49:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:49:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:49:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 43, 58121), True, datetime.datetime(2024, 4, 22, 3, 49, 43, 58121), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:49:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:49:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:49:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:49:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:53.759375+00:00 (in 9.999482 seconds)
notificationworker stdout | 2024-04-22 03:49:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:53 UTC)" (scheduled at 2024-04-22 03:49:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 43, 760181), True, datetime.datetime(2024, 4, 22, 3, 49, 43, 760181), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:49:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:49:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:14.952062+00:00 (in 29.999485 seconds)
gcworker stdout | 2024-04-22 03:49:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:14 UTC)" (scheduled at 2024-04-22 03:49:44.952062+00:00)
gcworker stdout | 2024-04-22 03:49:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548184952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:49:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:49:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:49:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:49:45,653 [281] [DEBUG] [app] Starting request: urn:request:ebe135f3-fcf8-4779-851a-f4c003adaa5f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:45,653 [278] [DEBUG] [app] Starting request: urn:request:01307f87-c2d8-4a83-a68e-724cf60144b5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [292] [DEBUG] [app] Starting request: urn:request:ed3b5bc4-0887-4293-a736-2e04d860ac24 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [291] [DEBUG] [app] Starting request: urn:request:b9c2f73d-5d90-4c8f-897a-cd158cbc832c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [292] [DEBUG] [app] Ending request: urn:request:ed3b5bc4-0887-4293-a736-2e04d860ac24 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed3b5bc4-0887-4293-a736-2e04d860ac24', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [291] [DEBUG] [app] Ending request: urn:request:b9c2f73d-5d90-4c8f-897a-cd158cbc832c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b9c2f73d-5d90-4c8f-897a-cd158cbc832c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:49:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:45,659 [278] [DEBUG] [app] Starting request: urn:request:9a2975a5-f0d9-4e30-bba0-c49746e84543 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:45,659 [278] [DEBUG] [app] Ending request: urn:request:9a2975a5-f0d9-4e30-bba0-c49746e84543 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a2975a5-f0d9-4e30-bba0-c49746e84543', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:45,659 [282] [DEBUG] [app] Starting request: urn:request:d26d0215-a051-4951-8c11-2ab6a2bb18d2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:45,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:45,660 [282] [DEBUG] [app] Ending request: urn:request:d26d0215-a051-4951-8c11-2ab6a2bb18d2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d26d0215-a051-4951-8c11-2ab6a2bb18d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:49:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:45,674 [278] [DEBUG] [app] Ending request: urn:request:01307f87-c2d8-4a83-a68e-724cf60144b5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:01307f87-c2d8-4a83-a68e-724cf60144b5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:49:45,675 [281] [DEBUG] [app] Ending request: urn:request:ebe135f3-fcf8-4779-851a-f4c003adaa5f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ebe135f3-fcf8-4779-851a-f4c003adaa5f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:49:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:49:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:49:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:17.052354+00:00 (in 29.999474 seconds)
buildlogsarchiver stdout | 2024-04-22 03:49:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:17 UTC)" (scheduled at 2024-04-22 03:49:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:49:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 49, 47, 53096), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:49:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:49:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:49:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:49:49,305 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:49:50,821 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:49:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:03.759375+00:00 (in 9.999469 seconds)
notificationworker stdout | 2024-04-22 03:49:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:03 UTC)" (scheduled at 2024-04-22 03:49:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 53, 760373), True, datetime.datetime(2024, 4, 22, 3, 49, 53, 760373), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:49:54,352 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:49:55,061 [89] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositoryactioncounter stdout | 2024-04-22 03:49:55,062 [89] [INFO] [apscheduler.executors.default] Running job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2024-04-22 03:49:55 UTC)" (scheduled at 2024-04-22 03:49:55.061170+00:00)
repositoryactioncounter stdout | 2024-04-22 03:49:55,062 [89] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "repository" AS "t1"', [])
repositoryactioncounter stdout | 2024-04-22 03:49:55,063 [89] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 07:49:55.061170+00:00 (in 14399.998081 seconds)
repositoryactioncounter stdout | 2024-04-22 03:49:55,072 [89] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "repository" AS "t1"', [])
repositoryactioncounter stdout | 2024-04-22 03:49:55,074 [89] [DEBUG] [data.database] Disconnecting from database.
repositoryactioncounter stdout | 2024-04-22 03:49:55,074 [89] [INFO] [apscheduler.executors.default] Job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2024-04-22 07:49:55 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:49:56,022 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:49:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:05.871852+00:00 (in 8.998236 seconds)
securityworker stdout | 2024-04-22 03:49:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:26 UTC)" (scheduled at 2024-04-22 03:49:56.873109+00:00)
securityworker stdout | 2024-04-22 03:49:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:49:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:49:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 44, 56, 881257), 1, 2])
securityworker stdout | 2024-04-22 03:49:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 44, 56, 881257), 1, 2])
securityworker stdout | 2024-04-22 03:49:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:49:57,477 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:49:59,362 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:49:59,412 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:49:59,817 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:49:59,820 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:49:59,823 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:49:59,830 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:49:59,836 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:50:00,414 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:50:00,653 [282] [DEBUG] [app] Starting request: urn:request:ed3f2529-7045-4ba7-8da5-bc60de77f48f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:00,653 [281] [DEBUG] [app] Starting request: urn:request:e33216a5-fc47-4a13-a57e-8defcf1b0e65 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [284] [DEBUG] [app] Starting request: urn:request:977e37e4-313c-4701-9ccc-841c0780a763 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [292] [DEBUG] [app] Starting request: urn:request:0a9bfcee-dff6-40e9-8d49-9b6b74ee8257 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [284] [DEBUG] [app] Ending request: urn:request:977e37e4-313c-4701-9ccc-841c0780a763 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:977e37e4-313c-4701-9ccc-841c0780a763', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [292] [DEBUG] [app] Ending request: urn:request:0a9bfcee-dff6-40e9-8d49-9b6b74ee8257 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0a9bfcee-dff6-40e9-8d49-9b6b74ee8257', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:00,659 [278] [DEBUG] [app] Starting request: urn:request:3aeb255c-0a18-4c1c-a5cf-6e046d3f314a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:00,660 [278] [DEBUG] [app] Ending request: urn:request:3aeb255c-0a18-4c1c-a5cf-6e046d3f314a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3aeb255c-0a18-4c1c-a5cf-6e046d3f314a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:00,660 [282] [DEBUG] [app] Starting request: urn:request:1ab631ee-9d5f-4111-9d2a-691713521c34 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [DEBUG] [app] Ending request: urn:request:1ab631ee-9d5f-4111-9d2a-691713521c34 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1ab631ee-9d5f-4111-9d2a-691713521c34', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:00,676 [282] [DEBUG] [app] Ending request: urn:request:ed3f2529-7045-4ba7-8da5-bc60de77f48f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ed3f2529-7045-4ba7-8da5-bc60de77f48f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:50:00,677 [281] [DEBUG] [app] Ending request: urn:request:e33216a5-fc47-4a13-a57e-8defcf1b0e65 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e33216a5-fc47-4a13-a57e-8defcf1b0e65', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 03:50:00,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:00,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:50:01,875 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:16.552337+00:00 (in 13.995591 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:02 UTC)" (scheduled at 2024-04-22 03:50:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:50:03,120 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:50:03,500 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:50:03,632 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:50:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:13.759375+00:00 (in 9.999457 seconds)
notificationworker stdout | 2024-04-22 03:50:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:13 UTC)" (scheduled at 2024-04-22 03:50:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 3, 760361), True, datetime.datetime(2024, 4, 22, 3, 50, 3, 760361), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:03,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:50:04,434 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:50:04,439 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:50:04,442 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:50:04,660 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:50:05,864 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:26.873109+00:00 (in 21.000749 seconds)
securityworker stdout | 2024-04-22 03:50:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:35 UTC)" (scheduled at 2024-04-22 03:50:05.871852+00:00)
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:35 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:50:06,060 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:50:06,159 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:50:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:50:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:13.555667+00:00 (in 7.002668 seconds)
repositorygcworker stdout | 2024-04-22 03:50:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:06 UTC)" (scheduled at 2024-04-22 03:50:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:50:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:50:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 6, 553395), True, datetime.datetime(2024, 4, 22, 3, 50, 6, 553395), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:50:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:50:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:50:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:50:07,077 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:50:08,473 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:50:08,508 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:50:08,874 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:50:08,950 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:50:10,151 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:50:10,663 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:50:10,679 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:50:10,681 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:50:10,687 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:50:10,690 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:50:10,694 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:50:10,696 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:50:10,703 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:50:10,706 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:50:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:50:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:41.264267+00:00 (in 29.999504 seconds)
autopruneworker stdout | 2024-04-22 03:50:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:41 UTC)" (scheduled at 2024-04-22 03:50:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:50:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757751271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:50:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:50:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:50:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:50:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:06.552482+00:00 (in 52.996350 seconds)
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:13 UTC)" (scheduled at 2024-04-22 03:50:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:50:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:19.762424+00:00 (in 6.002575 seconds)
notificationworker stdout | 2024-04-22 03:50:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:23 UTC)" (scheduled at 2024-04-22 03:50:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 13, 760280), True, datetime.datetime(2024, 4, 22, 3, 50, 13, 760280), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:50:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:50:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:44.952062+00:00 (in 29.999493 seconds)
gcworker stdout | 2024-04-22 03:50:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:44 UTC)" (scheduled at 2024-04-22 03:50:14.952062+00:00)
gcworker stdout | 2024-04-22 03:50:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548214952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:50:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:50:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:50:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:50:15,653 [278] [DEBUG] [app] Starting request: urn:request:8d958adb-a521-4009-ae45-4a2d7c585650 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:15,653 [281] [DEBUG] [app] Starting request: urn:request:42acd858-bd07-42f7-861b-47df3ff03205 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [290] [DEBUG] [app] Starting request: urn:request:a814449a-6ce1-4927-9af0-39f604cbba72 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [284] [DEBUG] [app] Starting request: urn:request:05562af6-a90e-4f6c-839b-d6a5d0f52d4d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [284] [DEBUG] [app] Ending request: urn:request:05562af6-a90e-4f6c-839b-d6a5d0f52d4d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05562af6-a90e-4f6c-839b-d6a5d0f52d4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [290] [DEBUG] [app] Ending request: urn:request:a814449a-6ce1-4927-9af0-39f604cbba72 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a814449a-6ce1-4927-9af0-39f604cbba72', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:50:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:50:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:15,659 [278] [DEBUG] [app] Starting request: urn:request:4410046f-e9a1-4f6c-964a-9c0d00ef2754 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:15,659 [278] [DEBUG] [app] Ending request: urn:request:4410046f-e9a1-4f6c-964a-9c0d00ef2754 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4410046f-e9a1-4f6c-964a-9c0d00ef2754', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:15,659 [282] [DEBUG] [app] Starting request: urn:request:05a6c5c7-d08b-48f3-88f7-cd4adb78705f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:15,660 [282] [DEBUG] [app] Ending request: urn:request:05a6c5c7-d08b-48f3-88f7-cd4adb78705f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:05a6c5c7-d08b-48f3-88f7-cd4adb78705f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:15,675 [278] [DEBUG] [app] Ending request: urn:request:8d958adb-a521-4009-ae45-4a2d7c585650 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8d958adb-a521-4009-ae45-4a2d7c585650', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:15,675 [281] [DEBUG] [app] Ending request: urn:request:42acd858-bd07-42f7-861b-47df3ff03205 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:42acd858-bd07-42f7-861b-47df3ff03205', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:50:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 03:50:15,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:02.556208+00:00 (in 46.003305 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:16 UTC)" (scheduled at 2024-04-22 03:50:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 16, 553346), True, datetime.datetime(2024, 4, 22, 3, 50, 16, 553346), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:50:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:50:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:47.052354+00:00 (in 29.999416 seconds)
buildlogsarchiver stdout | 2024-04-22 03:50:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:47 UTC)" (scheduled at 2024-04-22 03:50:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:50:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 50, 17, 53190), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:50:17,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:50:17,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:50:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:50:19,313 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:50:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:23.759375+00:00 (in 3.996404 seconds)
notificationworker stdout | 2024-04-22 03:50:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:19 UTC)" (scheduled at 2024-04-22 03:50:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:50:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:50:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:50:20,837 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:43.057186+00:00 (in 20.997642 seconds)
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:22 UTC)" (scheduled at 2024-04-22 03:50:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:50:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:50:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:33.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 03:50:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:33 UTC)" (scheduled at 2024-04-22 03:50:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 23, 760366), True, datetime.datetime(2024, 4, 22, 3, 50, 23, 760366), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:24.361582+00:00 (in 59.999479 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:24 UTC)" (scheduled at 2024-04-22 03:50:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
builder stdout | 2024-04-22 03:50:24,368 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:50:26,029 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:35.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 03:50:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:56 UTC)" (scheduled at 2024-04-22 03:50:26.873109+00:00)
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:50:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:50:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:50:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 45, 26, 880452), 1, 2])
securityworker stdout | 2024-04-22 03:50:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 45, 26, 880452), 1, 2])
securityworker stdout | 2024-04-22 03:50:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:50:27,510 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:50:29,377 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:50:29,448 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:50:29,824 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:50:29,828 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:50:29,830 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:50:29,837 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:50:29,842 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:50:30,450 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:50:30,653 [282] [DEBUG] [app] Starting request: urn:request:d803dd5d-c1c4-48cc-8335-4f3f6e48648b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:30,653 [278] [DEBUG] [app] Starting request: urn:request:d2e2fd90-5250-406a-b111-d27f02d3a1ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:30,656 [292] [DEBUG] [app] Starting request: urn:request:2b2da913-2180-496f-911f-ab3d51dc61dc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:30,656 [290] [DEBUG] [app] Starting request: urn:request:2191525a-cd6c-4ac5-888e-f08ecdb95e4d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [292] [DEBUG] [app] Ending request: urn:request:2b2da913-2180-496f-911f-ab3d51dc61dc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2b2da913-2180-496f-911f-ab3d51dc61dc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [290] [DEBUG] [app] Ending request: urn:request:2191525a-cd6c-4ac5-888e-f08ecdb95e4d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2191525a-cd6c-4ac5-888e-f08ecdb95e4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:50:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:30,660 [278] [DEBUG] [app] Starting request: urn:request:e5416f53-cccf-4236-aafa-79b82a2e3a0f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [281] [DEBUG] [app] Starting request: urn:request:5074e4d7-fc1a-4287-94f8-0aa12847524f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [278] [DEBUG] [app] Ending request: urn:request:e5416f53-cccf-4236-aafa-79b82a2e3a0f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e5416f53-cccf-4236-aafa-79b82a2e3a0f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [281] [DEBUG] [app] Ending request: urn:request:5074e4d7-fc1a-4287-94f8-0aa12847524f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5074e4d7-fc1a-4287-94f8-0aa12847524f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:50:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:30,670 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:30,675 [282] [DEBUG] [app] Ending request: urn:request:d803dd5d-c1c4-48cc-8335-4f3f6e48648b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d803dd5d-c1c4-48cc-8335-4f3f6e48648b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:50:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:50:30,678 [278] [DEBUG] [app] Ending request: urn:request:d2e2fd90-5250-406a-b111-d27f02d3a1ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d2e2fd90-5250-406a-b111-d27f02d3a1ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:30,678 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.027)
gunicorn-web stdout | 2024-04-22 03:50:30,679 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:50:31,911 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:50:33,156 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:50:33,535 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:50:33,651 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:50:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:43.759375+00:00 (in 9.999518 seconds)
notificationworker stdout | 2024-04-22 03:50:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:43 UTC)" (scheduled at 2024-04-22 03:50:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 33, 760234), True, datetime.datetime(2024, 4, 22, 3, 50, 33, 760234), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:50:34,442 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:50:34,448 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:50:34,450 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:50:34,695 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:50:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:56.873109+00:00 (in 21.000717 seconds)
securityworker stdout | 2024-04-22 03:50:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:05 UTC)" (scheduled at 2024-04-22 03:50:35.871852+00:00)
securityworker stdout | 2024-04-22 03:50:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:50:35,889 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:50:36,097 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:50:36,172 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:50:37,085 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:50:38,491 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:50:38,534 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:50:38,911 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:50:38,960 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:41.564959+00:00 (in 1.997439 seconds)
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:39 UTC)" (scheduled at 2024-04-22 03:50:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:50:40,176 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:50:40,676 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:50:40,687 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:50:40,690 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:50:40,694 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:50:40,698 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:50:40,701 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:50:40,704 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:50:40,713 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:50:40,716 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:50:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:50:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:11.264267+00:00 (in 29.999454 seconds)
autopruneworker stdout | 2024-04-22 03:50:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:11 UTC)" (scheduled at 2024-04-22 03:50:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:50:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757781272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:50:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:50:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:50:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:39.566970+00:00 (in 58.001489 seconds)
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:41 UTC)" (scheduled at 2024-04-22 03:50:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:50:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 41, 565853), True, datetime.datetime(2024, 4, 22, 3, 50, 41, 565853), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:50:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:50:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:50:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:50:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:50:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:22.058978+00:00 (in 39.001320 seconds)
namespacegcworker stdout | 2024-04-22 03:50:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:43 UTC)" (scheduled at 2024-04-22 03:50:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:50:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:50:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 43, 58038), True, datetime.datetime(2024, 4, 22, 3, 50, 43, 58038), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:50:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:50:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:50:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:50:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:53.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 03:50:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:53 UTC)" (scheduled at 2024-04-22 03:50:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 43, 760295), True, datetime.datetime(2024, 4, 22, 3, 50, 43, 760295), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:50:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:50:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:14.952062+00:00 (in 29.999504 seconds)
gcworker stdout | 2024-04-22 03:50:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:14 UTC)" (scheduled at 2024-04-22 03:50:44.952062+00:00)
gcworker stdout | 2024-04-22 03:50:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548244952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:50:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:50:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:50:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:50:45,653 [278] [DEBUG] [app] Starting request: urn:request:c4215457-03a9-4902-be4d-d8f0b4374d6a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:45,653 [282] [DEBUG] [app] Starting request: urn:request:bc10f44f-0cdb-4caa-beb1-a5175aacf2e9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [290] [DEBUG] [app] Starting request: urn:request:8862568e-00ab-4261-b99e-6b84807a414e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [284] [DEBUG] [app] Starting request: urn:request:9dbdff47-0de0-4f9f-a783-269397964999 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [284] [DEBUG] [app] Ending request: urn:request:9dbdff47-0de0-4f9f-a783-269397964999 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9dbdff47-0de0-4f9f-a783-269397964999', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [290] [DEBUG] [app] Ending request: urn:request:8862568e-00ab-4261-b99e-6b84807a414e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8862568e-00ab-4261-b99e-6b84807a414e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:50:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:45,659 [282] [DEBUG] [app] Starting request: urn:request:6d5dbff9-6a32-4085-9f83-cd2322b22a9c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:45,659 [282] [DEBUG] [app] Ending request: urn:request:6d5dbff9-6a32-4085-9f83-cd2322b22a9c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6d5dbff9-6a32-4085-9f83-cd2322b22a9c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:45,659 [279] [DEBUG] [app] Starting request: urn:request:c3713be6-ed8b-4027-992d-7c82d41424d3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:45,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:45,660 [279] [DEBUG] [app] Ending request: urn:request:c3713be6-ed8b-4027-992d-7c82d41424d3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c3713be6-ed8b-4027-992d-7c82d41424d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:45,674 [282] [DEBUG] [app] Ending request: urn:request:bc10f44f-0cdb-4caa-beb1-a5175aacf2e9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bc10f44f-0cdb-4caa-beb1-a5175aacf2e9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:50:45,675 [278] [DEBUG] [app] Ending request: urn:request:c4215457-03a9-4902-be4d-d8f0b4374d6a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c4215457-03a9-4902-be4d-d8f0b4374d6a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:50:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:50:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:50:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:17.052354+00:00 (in 29.999449 seconds)
buildlogsarchiver stdout | 2024-04-22 03:50:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:17 UTC)" (scheduled at 2024-04-22 03:50:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:50:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 50, 47, 53274), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:50:47,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:50:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:50:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:50:49,337 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:50:50,873 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:50:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:03.759375+00:00 (in 9.999494 seconds)
notificationworker stdout | 2024-04-22 03:50:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:03 UTC)" (scheduled at 2024-04-22 03:50:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 53, 760330), True, datetime.datetime(2024, 4, 22, 3, 50, 53, 760330), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:50:54,397 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:50:56,066 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:05.871852+00:00 (in 8.998238 seconds)
securityworker stdout | 2024-04-22 03:50:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:26 UTC)" (scheduled at 2024-04-22 03:50:56.873109+00:00)
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:50:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:50:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:50:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 45, 56, 880532), 1, 2])
securityworker stdout | 2024-04-22 03:50:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 45, 56, 880532), 1, 2])
securityworker stdout | 2024-04-22 03:50:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:50:57,546 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:50:59,413 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:50:59,477 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:50:59,833 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:50:59,837 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:50:59,840 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:50:59,843 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:50:59,848 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:51:00,471 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:51:00,653 [282] [DEBUG] [app] Starting request: urn:request:ab74a8e9-50e4-4d33-8c85-f6a50e756e8a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:00,653 [281] [DEBUG] [app] Starting request: urn:request:873c19f3-8cc0-4dea-b0d6-1aae0700c6a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:00,656 [284] [DEBUG] [app] Starting request: urn:request:2d280a26-496f-44a6-a752-6459561ccf8d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:00,656 [289] [DEBUG] [app] Starting request: urn:request:43b344a5-ee63-4fc2-897c-e1cd6787dbbb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [284] [DEBUG] [app] Ending request: urn:request:2d280a26-496f-44a6-a752-6459561ccf8d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2d280a26-496f-44a6-a752-6459561ccf8d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [289] [DEBUG] [app] Ending request: urn:request:43b344a5-ee63-4fc2-897c-e1cd6787dbbb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43b344a5-ee63-4fc2-897c-e1cd6787dbbb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:00,660 [281] [DEBUG] [app] Starting request: urn:request:04e158d1-c636-4681-ac06-695ca42037b0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:00,660 [278] [DEBUG] [app] Starting request: urn:request:b644eed7-92fd-49ab-bb64-5641b46adb7d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:00,660 [278] [DEBUG] [app] Ending request: urn:request:b644eed7-92fd-49ab-bb64-5641b46adb7d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b644eed7-92fd-49ab-bb64-5641b46adb7d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:00,660 [281] [DEBUG] [app] Ending request: urn:request:04e158d1-c636-4681-ac06-695ca42037b0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:04e158d1-c636-4681-ac06-695ca42037b0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:00,676 [282] [DEBUG] [app] Ending request: urn:request:ab74a8e9-50e4-4d33-8c85-f6a50e756e8a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ab74a8e9-50e4-4d33-8c85-f6a50e756e8a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:51:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:51:00,676 [281] [DEBUG] [app] Ending request: urn:request:873c19f3-8cc0-4dea-b0d6-1aae0700c6a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:873c19f3-8cc0-4dea-b0d6-1aae0700c6a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:00,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:51:01,947 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:16.552337+00:00 (in 13.995579 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:02 UTC)" (scheduled at 2024-04-22 03:51:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:51:03,193 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:51:03,559 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:51:03,664 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:51:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:13.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 03:51:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:13 UTC)" (scheduled at 2024-04-22 03:51:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 3, 760205), True, datetime.datetime(2024, 4, 22, 3, 51, 3, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:51:04,450 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:51:04,455 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:51:04,457 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:51:04,719 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:26.873109+00:00 (in 21.000680 seconds)
securityworker stdout | 2024-04-22 03:51:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:35 UTC)" (scheduled at 2024-04-22 03:51:05.871852+00:00)
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:51:05,926 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:51:06,129 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:51:06,207 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:51:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:51:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:13.555667+00:00 (in 7.002691 seconds)
repositorygcworker stdout | 2024-04-22 03:51:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:06 UTC)" (scheduled at 2024-04-22 03:51:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:51:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:51:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 6, 553398), True, datetime.datetime(2024, 4, 22, 3, 51, 6, 553398), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:51:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:51:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:51:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:51:07,120 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:51:08,502 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:51:08,565 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:51:08,947 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:51:08,996 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:51:10,203 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:51:10,688 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:51:10,693 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:51:10,701 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:51:10,704 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:51:10,708 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:51:10,712 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:51:10,714 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:51:10,724 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:51:10,726 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:51:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:51:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:51:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:41 UTC)" (scheduled at 2024-04-22 03:51:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:51:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757811272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:51:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:51:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:51:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:51:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:51.555445+00:00 (in 37.999319 seconds)
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:13 UTC)" (scheduled at 2024-04-22 03:51:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:19.762424+00:00 (in 6.002548 seconds)
notificationworker stdout | 2024-04-22 03:51:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:23 UTC)" (scheduled at 2024-04-22 03:51:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 13, 760289), True, datetime.datetime(2024, 4, 22, 3, 51, 13, 760289), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:51:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:51:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:44.952062+00:00 (in 29.999457 seconds)
gcworker stdout | 2024-04-22 03:51:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:44 UTC)" (scheduled at 2024-04-22 03:51:14.952062+00:00)
gcworker stdout | 2024-04-22 03:51:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548274953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:51:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:51:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:51:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:51:15,653 [279] [DEBUG] [app] Starting request: urn:request:4f67cba9-e856-47ee-be17-1f6d34a565bb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:15,653 [278] [DEBUG] [app] Starting request: urn:request:f0d660cb-267c-4e28-b31f-df84a07d5074 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [288] [DEBUG] [app] Starting request: urn:request:8b734808-a131-4d32-a899-10ff76de3398 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [284] [DEBUG] [app] Starting request: urn:request:9151c492-fc45-4228-b612-553dcd52f819 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [288] [DEBUG] [app] Ending request: urn:request:8b734808-a131-4d32-a899-10ff76de3398 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8b734808-a131-4d32-a899-10ff76de3398', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [284] [DEBUG] [app] Ending request: urn:request:9151c492-fc45-4228-b612-553dcd52f819 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9151c492-fc45-4228-b612-553dcd52f819', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:15,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:51:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:51:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:15,661 [281] [DEBUG] [app] Starting request: urn:request:b4cb03fd-bd88-44b7-949a-593e938b7604 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:15,661 [282] [DEBUG] [app] Starting request: urn:request:42936e8e-eb73-45d7-8b7a-da8bc678ccab (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:15,661 [281] [DEBUG] [app] Ending request: urn:request:b4cb03fd-bd88-44b7-949a-593e938b7604 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b4cb03fd-bd88-44b7-949a-593e938b7604', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:15,661 [282] [DEBUG] [app] Ending request: urn:request:42936e8e-eb73-45d7-8b7a-da8bc678ccab (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:42936e8e-eb73-45d7-8b7a-da8bc678ccab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:15,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:15,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:15,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:15,670 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:15,676 [278] [DEBUG] [app] Ending request: urn:request:f0d660cb-267c-4e28-b31f-df84a07d5074 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0d660cb-267c-4e28-b31f-df84a07d5074', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:15,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:51:15,678 [279] [DEBUG] [app] Ending request: urn:request:4f67cba9-e856-47ee-be17-1f6d34a565bb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4f67cba9-e856-47ee-be17-1f6d34a565bb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:15,678 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:15,678 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:02.556208+00:00 (in 46.003254 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:16 UTC)" (scheduled at 2024-04-22 03:51:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 16, 553321), True, datetime.datetime(2024, 4, 22, 3, 51, 16, 553321), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:51:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:51:17,053 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:47.052354+00:00 (in 29.999329 seconds)
buildlogsarchiver stdout | 2024-04-22 03:51:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:47 UTC)" (scheduled at 2024-04-22 03:51:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:51:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 51, 17, 53386), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:51:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:51:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:51:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:51:19,357 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:51:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:23.759375+00:00 (in 3.996370 seconds)
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:19 UTC)" (scheduled at 2024-04-22 03:51:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:51:20,886 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:43.057186+00:00 (in 20.997717 seconds)
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:22 UTC)" (scheduled at 2024-04-22 03:51:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:33.759375+00:00 (in 9.999490 seconds)
notificationworker stdout | 2024-04-22 03:51:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:33 UTC)" (scheduled at 2024-04-22 03:51:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 23, 760237), True, datetime.datetime(2024, 4, 22, 3, 51, 23, 760237), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:23,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:23,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:23,776 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:24.361582+00:00 (in 59.999460 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:24 UTC)" (scheduled at 2024-04-22 03:51:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:51:24,433 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:51:26,103 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:51:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:35.871852+00:00 (in 8.998225 seconds)
securityworker stdout | 2024-04-22 03:51:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:56 UTC)" (scheduled at 2024-04-22 03:51:26.873109+00:00)
securityworker stdout | 2024-04-22 03:51:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:51:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:51:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 46, 26, 881945), 1, 2])
securityworker stdout | 2024-04-22 03:51:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 46, 26, 881945), 1, 2])
securityworker stdout | 2024-04-22 03:51:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:51:27,572 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:51:29,450 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:51:29,500 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:51:29,843 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:51:29,847 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:51:29,850 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:51:29,852 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:51:29,855 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:51:30,497 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:51:30,653 [282] [DEBUG] [app] Starting request: urn:request:87161268-b543-4dbc-97c9-f16b26463260 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:30,653 [278] [DEBUG] [app] Starting request: urn:request:9e2c8dd1-8fb2-474f-8710-cec9e7061c03 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:30,656 [284] [DEBUG] [app] Starting request: urn:request:3d4c6d5b-e7b7-4d46-b73b-994babf5f54d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [284] [DEBUG] [app] Ending request: urn:request:3d4c6d5b-e7b7-4d46-b73b-994babf5f54d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3d4c6d5b-e7b7-4d46-b73b-994babf5f54d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [292] [DEBUG] [app] Starting request: urn:request:7a678fe9-1e5c-4990-b810-fabdfcd88098 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [292] [DEBUG] [app] Ending request: urn:request:7a678fe9-1e5c-4990-b810-fabdfcd88098 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7a678fe9-1e5c-4990-b810-fabdfcd88098', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:51:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:51:30,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:51:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:30,660 [282] [DEBUG] [app] Starting request: urn:request:440e72ca-a6a4-4b0a-b292-a2f146f9f916 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:30,660 [282] [DEBUG] [app] Ending request: urn:request:440e72ca-a6a4-4b0a-b292-a2f146f9f916 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:440e72ca-a6a4-4b0a-b292-a2f146f9f916', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:30,660 [278] [DEBUG] [app] Starting request: urn:request:64ff6b56-29fe-406b-862d-5bd25042e8cc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:30,660 [278] [DEBUG] [app] Ending request: urn:request:64ff6b56-29fe-406b-862d-5bd25042e8cc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:64ff6b56-29fe-406b-862d-5bd25042e8cc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:51:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:51:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:30,677 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:30,680 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:30,685 [278] [DEBUG] [app] Ending request: urn:request:9e2c8dd1-8fb2-474f-8710-cec9e7061c03 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9e2c8dd1-8fb2-474f-8710-cec9e7061c03', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:30,685 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:30,685 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.032 118 0.032)
gunicorn-web stdout | 2024-04-22 03:51:30,687 [282] [DEBUG] [app] Ending request: urn:request:87161268-b543-4dbc-97c9-f16b26463260 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:87161268-b543-4dbc-97c9-f16b26463260', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:30,688 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.036 118 0.035)
gunicorn-web stdout | 2024-04-22 03:51:30,688 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:51:31,985 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:51:33,211 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:51:33,567 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:51:33,684 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:51:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:43.759375+00:00 (in 9.999442 seconds)
notificationworker stdout | 2024-04-22 03:51:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:43 UTC)" (scheduled at 2024-04-22 03:51:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 33, 760281), True, datetime.datetime(2024, 4, 22, 3, 51, 33, 760281), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:51:34,460 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:51:34,464 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:51:34,466 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:51:34,755 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:51:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:56.873109+00:00 (in 21.000723 seconds)
securityworker stdout | 2024-04-22 03:51:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:05 UTC)" (scheduled at 2024-04-22 03:51:35.871852+00:00)
securityworker stdout | 2024-04-22 03:51:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:35,891 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:35,893 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:35,893 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:51:35,948 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:51:36,154 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:51:36,216 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:51:37,135 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:51:38,514 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:51:38,593 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:51:38,969 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:51:39,031 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:41.564959+00:00 (in 1.997494 seconds)
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:39 UTC)" (scheduled at 2024-04-22 03:51:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:51:40,239 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:51:40,700 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:51:40,704 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:51:40,710 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:51:40,713 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:51:40,718 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:51:40,722 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:51:40,726 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:51:40,733 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:51:40,736 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:51:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:51:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:11.264267+00:00 (in 29.999534 seconds)
autopruneworker stdout | 2024-04-22 03:51:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:11 UTC)" (scheduled at 2024-04-22 03:51:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:51:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757841271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:51:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:51:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:51:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:53.566665+00:00 (in 12.001205 seconds)
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:41 UTC)" (scheduled at 2024-04-22 03:51:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:51:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 41, 565727), True, datetime.datetime(2024, 4, 22, 3, 51, 41, 565727), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:51:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:51:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:51:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:51:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:51:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:22.058978+00:00 (in 39.001306 seconds)
namespacegcworker stdout | 2024-04-22 03:51:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:43 UTC)" (scheduled at 2024-04-22 03:51:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:51:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:51:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 43, 58125), True, datetime.datetime(2024, 4, 22, 3, 51, 43, 58125), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:51:43,072 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:51:43,072 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:51:43,072 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:53.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 03:51:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:53 UTC)" (scheduled at 2024-04-22 03:51:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 43, 760131), True, datetime.datetime(2024, 4, 22, 3, 51, 43, 760131), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:51:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:51:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:14.952062+00:00 (in 29.999545 seconds)
gcworker stdout | 2024-04-22 03:51:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:14 UTC)" (scheduled at 2024-04-22 03:51:44.952062+00:00)
gcworker stdout | 2024-04-22 03:51:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548304952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:51:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:51:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:51:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:51:45,653 [279] [DEBUG] [app] Starting request: urn:request:17c0e021-a324-407b-a085-130f877ed44c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:45,653 [282] [DEBUG] [app] Starting request: urn:request:8770e130-f8a0-4bbf-8bde-96463580f7dd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [291] [DEBUG] [app] Starting request: urn:request:cd6853e9-c0da-445c-8589-059a6c159d28 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [292] [DEBUG] [app] Starting request: urn:request:e2f76d70-7038-4f32-a334-f3467b8ff186 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [291] [DEBUG] [app] Ending request: urn:request:cd6853e9-c0da-445c-8589-059a6c159d28 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cd6853e9-c0da-445c-8589-059a6c159d28', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [292] [DEBUG] [app] Ending request: urn:request:e2f76d70-7038-4f32-a334-f3467b8ff186 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e2f76d70-7038-4f32-a334-f3467b8ff186', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:45,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:51:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:45,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:45,661 [278] [DEBUG] [app] Starting request: urn:request:4001db54-d17c-4aa6-a928-0897e128b1ba (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:45,661 [281] [DEBUG] [app] Starting request: urn:request:73a60727-b66c-4bcf-b5f5-c3fb5e6b9938 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:45,661 [278] [DEBUG] [app] Ending request: urn:request:4001db54-d17c-4aa6-a928-0897e128b1ba (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4001db54-d17c-4aa6-a928-0897e128b1ba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:45,661 [281] [DEBUG] [app] Ending request: urn:request:73a60727-b66c-4bcf-b5f5-c3fb5e6b9938 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:73a60727-b66c-4bcf-b5f5-c3fb5e6b9938', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:45,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:45,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:45,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:45,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:45,676 [282] [DEBUG] [app] Ending request: urn:request:8770e130-f8a0-4bbf-8bde-96463580f7dd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8770e130-f8a0-4bbf-8bde-96463580f7dd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:45,677 [279] [DEBUG] [app] Ending request: urn:request:17c0e021-a324-407b-a085-130f877ed44c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:17c0e021-a324-407b-a085-130f877ed44c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:45,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:51:45,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:45,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
buildlogsarchiver stdout | 2024-04-22 03:51:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:51:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:17.052354+00:00 (in 29.999505 seconds)
buildlogsarchiver stdout | 2024-04-22 03:51:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:17 UTC)" (scheduled at 2024-04-22 03:51:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:51:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 51, 47, 53182), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:51:47,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:51:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:51:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:51:49,393 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:51:50,909 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:51:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:51:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:06.552482+00:00 (in 14.996519 seconds)
repositorygcworker stdout | 2024-04-22 03:51:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:51 UTC)" (scheduled at 2024-04-22 03:51:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:51:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:51:51,578 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), True, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:51:51,581 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), True, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:51:51,583 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:51:51,583 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:51:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:51:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:39.566970+00:00 (in 45.999751 seconds)
exportactionlogsworker stdout | 2024-04-22 03:51:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:53 UTC)" (scheduled at 2024-04-22 03:51:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:51:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:51:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), True, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:51:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), True, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:51:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:51:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:03.759375+00:00 (in 9.999511 seconds)
notificationworker stdout | 2024-04-22 03:51:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:03 UTC)" (scheduled at 2024-04-22 03:51:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 53, 760174), True, datetime.datetime(2024, 4, 22, 3, 51, 53, 760174), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:51:54,455 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:51:56,139 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:51:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:05.871852+00:00 (in 8.998230 seconds)
securityworker stdout | 2024-04-22 03:51:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:26 UTC)" (scheduled at 2024-04-22 03:51:56.873109+00:00)
securityworker stdout | 2024-04-22 03:51:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:51:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:51:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:51:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 46, 56, 880812), 1, 2])
securityworker stdout | 2024-04-22 03:51:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 46, 56, 880812), 1, 2])
securityworker stdout | 2024-04-22 03:51:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:51:57,581 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:51:59,457 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:51:59,537 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:51:59,851 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:51:59,856 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:51:59,859 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:51:59,863 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:51:59,866 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:52:00,527 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:52:00,653 [282] [DEBUG] [app] Starting request: urn:request:ec7e93fa-fad7-4969-a860-d3d9db3aa589 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:00,653 [278] [DEBUG] [app] Starting request: urn:request:f7324aba-3f1d-4bc3-a7c7-9fcc7eebb2ce (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [292] [DEBUG] [app] Starting request: urn:request:f8b3c027-06bd-4624-80d6-e2e1d2b5519f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [292] [DEBUG] [app] Ending request: urn:request:f8b3c027-06bd-4624-80d6-e2e1d2b5519f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f8b3c027-06bd-4624-80d6-e2e1d2b5519f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [284] [DEBUG] [app] Starting request: urn:request:bd09263c-d94c-47e3-89b5-2eaf6b7d521e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [284] [DEBUG] [app] Ending request: urn:request:bd09263c-d94c-47e3-89b5-2eaf6b7d521e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bd09263c-d94c-47e3-89b5-2eaf6b7d521e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:52:00,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:52:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:00,660 [282] [DEBUG] [app] Starting request: urn:request:a3407df2-11e1-4efe-9c03-8919e9429f0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:00,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:00,660 [282] [DEBUG] [app] Ending request: urn:request:a3407df2-11e1-4efe-9c03-8919e9429f0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a3407df2-11e1-4efe-9c03-8919e9429f0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:00,661 [281] [DEBUG] [app] Starting request: urn:request:bf5f239a-57cb-4f5a-89f9-4ae0ce6487cd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:00,662 [281] [DEBUG] [app] Ending request: urn:request:bf5f239a-57cb-4f5a-89f9-4ae0ce6487cd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bf5f239a-57cb-4f5a-89f9-4ae0ce6487cd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:00,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:00,675 [282] [DEBUG] [app] Ending request: urn:request:ec7e93fa-fad7-4969-a860-d3d9db3aa589 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ec7e93fa-fad7-4969-a860-d3d9db3aa589', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:52:00,676 [278] [DEBUG] [app] Ending request: urn:request:f7324aba-3f1d-4bc3-a7c7-9fcc7eebb2ce (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f7324aba-3f1d-4bc3-a7c7-9fcc7eebb2ce', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
notificationworker stdout | 2024-04-22 03:52:02,007 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:16.552337+00:00 (in 13.995574 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:02 UTC)" (scheduled at 2024-04-22 03:52:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:52:03,247 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:52:03,582 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:52:03,696 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:52:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:13.759375+00:00 (in 9.999554 seconds)
notificationworker stdout | 2024-04-22 03:52:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:13 UTC)" (scheduled at 2024-04-22 03:52:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 3, 760074), True, datetime.datetime(2024, 4, 22, 3, 52, 3, 760074), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:52:04,469 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:52:04,472 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:52:04,474 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:52:04,792 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:52:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:26.873109+00:00 (in 21.000702 seconds)
securityworker stdout | 2024-04-22 03:52:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:35 UTC)" (scheduled at 2024-04-22 03:52:05.871852+00:00)
securityworker stdout | 2024-04-22 03:52:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:52:05,978 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:52:06,179 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:52:06,252 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:52:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:52:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:13.555667+00:00 (in 7.002654 seconds)
repositorygcworker stdout | 2024-04-22 03:52:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:06 UTC)" (scheduled at 2024-04-22 03:52:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:52:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:52:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 6, 553457), True, datetime.datetime(2024, 4, 22, 3, 52, 6, 553457), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:52:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:52:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:52:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:52:07,157 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:52:08,524 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:52:08,625 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:52:09,005 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:52:09,068 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:52:10,276 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:52:10,711 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:52:10,716 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:52:10,722 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:52:10,726 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:52:10,728 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:52:10,732 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:52:10,736 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:52:10,741 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:52:10,743 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:52:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:52:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:41.264267+00:00 (in 29.999561 seconds)
autopruneworker stdout | 2024-04-22 03:52:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:41 UTC)" (scheduled at 2024-04-22 03:52:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:52:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757871271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:52:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:52:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:52:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:52:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:06.552482+00:00 (in 52.996303 seconds)
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:13 UTC)" (scheduled at 2024-04-22 03:52:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:52:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:19.762424+00:00 (in 6.002579 seconds)
notificationworker stdout | 2024-04-22 03:52:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:23 UTC)" (scheduled at 2024-04-22 03:52:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 13, 760140), True, datetime.datetime(2024, 4, 22, 3, 52, 13, 760140), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:52:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:52:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:44.952062+00:00 (in 29.999527 seconds)
gcworker stdout | 2024-04-22 03:52:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:44 UTC)" (scheduled at 2024-04-22 03:52:14.952062+00:00)
gcworker stdout | 2024-04-22 03:52:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548334952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:52:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:52:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:52:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:52:15,653 [278] [DEBUG] [app] Starting request: urn:request:2df539c4-2b18-47c9-8824-073e1da4def1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:15,653 [282] [DEBUG] [app] Starting request: urn:request:92f327ad-cf41-4532-a6e9-4f9aa583b644 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:15,656 [292] [DEBUG] [app] Starting request: urn:request:620f2fe7-3414-407e-aa9d-8efe113663dc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:15,656 [284] [DEBUG] [app] Starting request: urn:request:53695c73-90c7-4a64-8914-e30cf0bfca3c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [292] [DEBUG] [app] Ending request: urn:request:620f2fe7-3414-407e-aa9d-8efe113663dc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:620f2fe7-3414-407e-aa9d-8efe113663dc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [284] [DEBUG] [app] Ending request: urn:request:53695c73-90c7-4a64-8914-e30cf0bfca3c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:53695c73-90c7-4a64-8914-e30cf0bfca3c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:15,660 [278] [DEBUG] [app] Starting request: urn:request:d52e39ac-c131-40e1-b5d8-b3ec24e68bfc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:15,660 [281] [DEBUG] [app] Starting request: urn:request:e3fe117e-dc5d-4b68-80e3-355f7966cf9e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:15,660 [278] [DEBUG] [app] Ending request: urn:request:d52e39ac-c131-40e1-b5d8-b3ec24e68bfc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d52e39ac-c131-40e1-b5d8-b3ec24e68bfc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:15,660 [281] [DEBUG] [app] Ending request: urn:request:e3fe117e-dc5d-4b68-80e3-355f7966cf9e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e3fe117e-dc5d-4b68-80e3-355f7966cf9e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:52:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:15,675 [278] [DEBUG] [app] Ending request: urn:request:2df539c4-2b18-47c9-8824-073e1da4def1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2df539c4-2b18-47c9-8824-073e1da4def1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 03:52:15,676 [282] [DEBUG] [app] Ending request: urn:request:92f327ad-cf41-4532-a6e9-4f9aa583b644 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:92f327ad-cf41-4532-a6e9-4f9aa583b644', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:52:15,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:21.555879+00:00 (in 5.002891 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:16 UTC)" (scheduled at 2024-04-22 03:52:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 16, 553426), True, datetime.datetime(2024, 4, 22, 3, 52, 16, 553426), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:52:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:52:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:47.052354+00:00 (in 29.999477 seconds)
buildlogsarchiver stdout | 2024-04-22 03:52:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:47 UTC)" (scheduled at 2024-04-22 03:52:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:52:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 52, 17, 53088), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:52:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:52:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:52:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:52:19,425 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:52:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:23.759375+00:00 (in 3.996429 seconds)
notificationworker stdout | 2024-04-22 03:52:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:19 UTC)" (scheduled at 2024-04-22 03:52:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:52:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:52:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:52:20,942 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:02.556208+00:00 (in 40.999782 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:21 UTC)" (scheduled at 2024-04-22 03:52:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), True, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), True, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:38.058708+00:00 (in 15.999189 seconds)
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:22 UTC)" (scheduled at 2024-04-22 03:52:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:52:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:52:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:33.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 03:52:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:33 UTC)" (scheduled at 2024-04-22 03:52:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 23, 760251), True, datetime.datetime(2024, 4, 22, 3, 52, 23, 760251), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:24.361582+00:00 (in 59.999411 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:24 UTC)" (scheduled at 2024-04-22 03:52:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:52:24,476 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:52:26,148 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:52:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:35.871852+00:00 (in 8.998260 seconds)
securityworker stdout | 2024-04-22 03:52:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:56 UTC)" (scheduled at 2024-04-22 03:52:26.873109+00:00)
securityworker stdout | 2024-04-22 03:52:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:52:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:52:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 47, 26, 881367), 1, 2])
securityworker stdout | 2024-04-22 03:52:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 47, 26, 881367), 1, 2])
securityworker stdout | 2024-04-22 03:52:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:52:27,614 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:52:29,494 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:52:29,552 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:52:29,859 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:52:29,865 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:52:29,867 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:52:29,870 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:52:29,874 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:52:30,555 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:52:30,653 [282] [DEBUG] [app] Starting request: urn:request:cb047743-79fa-4c5c-9640-33d13b43a33e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:30,653 [281] [DEBUG] [app] Starting request: urn:request:949760cc-5474-49cb-a3f1-8e557f029acb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:30,656 [284] [DEBUG] [app] Starting request: urn:request:5a6c06d6-9358-4d23-a198-7210d97a2bb8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:30,656 [292] [DEBUG] [app] Starting request: urn:request:58e1e92b-1860-4829-b30e-35e19f067e67 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [284] [DEBUG] [app] Ending request: urn:request:5a6c06d6-9358-4d23-a198-7210d97a2bb8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5a6c06d6-9358-4d23-a198-7210d97a2bb8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [292] [DEBUG] [app] Ending request: urn:request:58e1e92b-1860-4829-b30e-35e19f067e67 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:58e1e92b-1860-4829-b30e-35e19f067e67', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:52:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:30,660 [279] [DEBUG] [app] Starting request: urn:request:1c4ba3af-d312-40fd-a41b-44a64f5fa82d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:30,660 [279] [DEBUG] [app] Ending request: urn:request:1c4ba3af-d312-40fd-a41b-44a64f5fa82d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1c4ba3af-d312-40fd-a41b-44a64f5fa82d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:30,660 [282] [DEBUG] [app] Starting request: urn:request:bf8b5b01-1115-4b13-9d1b-01596699b92a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:52:30,661 [282] [DEBUG] [app] Ending request: urn:request:bf8b5b01-1115-4b13-9d1b-01596699b92a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bf8b5b01-1115-4b13-9d1b-01596699b92a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:30,676 [282] [DEBUG] [app] Ending request: urn:request:cb047743-79fa-4c5c-9640-33d13b43a33e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cb047743-79fa-4c5c-9640-33d13b43a33e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:52:30,676 [281] [DEBUG] [app] Ending request: urn:request:949760cc-5474-49cb-a3f1-8e557f029acb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:949760cc-5474-49cb-a3f1-8e557f029acb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:52:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:52:32,027 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:52:33,283 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:52:33,614 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:52:33,733 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:52:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:43.759375+00:00 (in 9.999526 seconds)
notificationworker stdout | 2024-04-22 03:52:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:43 UTC)" (scheduled at 2024-04-22 03:52:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 33, 760240), True, datetime.datetime(2024, 4, 22, 3, 52, 33, 760240), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:52:34,479 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:52:34,481 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:52:34,484 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:52:34,828 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:56.873109+00:00 (in 21.000755 seconds)
securityworker stdout | 2024-04-22 03:52:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:05 UTC)" (scheduled at 2024-04-22 03:52:35.871852+00:00)
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:52:35,999 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:52:36,207 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:52:36,290 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:52:37,181 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 03:52:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:52:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:43.057186+00:00 (in 4.997999 seconds)
namespacegcworker stdout | 2024-04-22 03:52:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:38 UTC)" (scheduled at 2024-04-22 03:52:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:52:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:52:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), True, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:52:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), True, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:52:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:52:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:52:38,532 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:52:38,661 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:52:39,029 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:52:39,104 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:41.564959+00:00 (in 1.997460 seconds)
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:39 UTC)" (scheduled at 2024-04-22 03:52:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:52:40,304 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:52:40,721 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:52:40,727 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:52:40,732 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:52:40,734 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:52:40,738 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:52:40,741 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:52:40,744 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:52:40,748 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:52:40,751 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:52:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:52:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:11.264267+00:00 (in 29.999578 seconds)
autopruneworker stdout | 2024-04-22 03:52:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:11 UTC)" (scheduled at 2024-04-22 03:52:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:52:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757901271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:52:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:52:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:52:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:39.566970+00:00 (in 58.001470 seconds)
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:41 UTC)" (scheduled at 2024-04-22 03:52:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:52:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 41, 565815), True, datetime.datetime(2024, 4, 22, 3, 52, 41, 565815), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:52:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:52:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:52:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:22.058978+00:00 (in 39.001337 seconds)
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:43 UTC)" (scheduled at 2024-04-22 03:52:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:52:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 43, 57928), True, datetime.datetime(2024, 4, 22, 3, 52, 43, 57928), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:52:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:52:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:52:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:52:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:53.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 03:52:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:53 UTC)" (scheduled at 2024-04-22 03:52:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 43, 760102), True, datetime.datetime(2024, 4, 22, 3, 52, 43, 760102), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:52:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:52:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:14.952062+00:00 (in 29.999485 seconds)
gcworker stdout | 2024-04-22 03:52:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:14 UTC)" (scheduled at 2024-04-22 03:52:44.952062+00:00)
gcworker stdout | 2024-04-22 03:52:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548364952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:52:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:52:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:52:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:52:45,653 [282] [DEBUG] [app] Starting request: urn:request:237878ed-9601-4f48-883e-fb9eeeac05d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:45,653 [279] [DEBUG] [app] Starting request: urn:request:c10638f8-6bf2-48ce-ba3f-7ed8fb75e414 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [289] [DEBUG] [app] Starting request: urn:request:d856df3e-6374-47e9-8ec5-008d69dbcd86 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [284] [DEBUG] [app] Starting request: urn:request:4ccdb0d9-f66f-40c2-826a-97b23a464c6f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [284] [DEBUG] [app] Ending request: urn:request:4ccdb0d9-f66f-40c2-826a-97b23a464c6f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4ccdb0d9-f66f-40c2-826a-97b23a464c6f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [289] [DEBUG] [app] Ending request: urn:request:d856df3e-6374-47e9-8ec5-008d69dbcd86 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d856df3e-6374-47e9-8ec5-008d69dbcd86', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:52:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:52:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:45,659 [282] [DEBUG] [app] Starting request: urn:request:dff641e2-05d1-44ea-bc02-07efcf3459e6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:45,659 [278] [DEBUG] [app] Starting request: urn:request:62ad3c3d-7c57-4465-8e99-03f5a5331082 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [DEBUG] [app] Ending request: urn:request:dff641e2-05d1-44ea-bc02-07efcf3459e6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dff641e2-05d1-44ea-bc02-07efcf3459e6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:45,660 [278] [DEBUG] [app] Ending request: urn:request:62ad3c3d-7c57-4465-8e99-03f5a5331082 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:62ad3c3d-7c57-4465-8e99-03f5a5331082', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:45,674 [282] [DEBUG] [app] Ending request: urn:request:237878ed-9601-4f48-883e-fb9eeeac05d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:237878ed-9601-4f48-883e-fb9eeeac05d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:52:45,674 [279] [DEBUG] [app] Ending request: urn:request:c10638f8-6bf2-48ce-ba3f-7ed8fb75e414 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c10638f8-6bf2-48ce-ba3f-7ed8fb75e414', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:52:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:52:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:52:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:17.052354+00:00 (in 29.999453 seconds)
buildlogsarchiver stdout | 2024-04-22 03:52:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:17 UTC)" (scheduled at 2024-04-22 03:52:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:52:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 52, 47, 53174), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:52:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:52:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:52:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:52:49,443 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:52:50,960 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:52:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:03.759375+00:00 (in 9.999509 seconds)
notificationworker stdout | 2024-04-22 03:52:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:03 UTC)" (scheduled at 2024-04-22 03:52:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 53, 760265), True, datetime.datetime(2024, 4, 22, 3, 52, 53, 760265), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:52:54,507 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:52:56,176 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:52:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:05.871852+00:00 (in 8.998187 seconds)
securityworker stdout | 2024-04-22 03:52:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:26 UTC)" (scheduled at 2024-04-22 03:52:56.873109+00:00)
securityworker stdout | 2024-04-22 03:52:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:52:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:52:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 47, 56, 881354), 1, 2])
securityworker stdout | 2024-04-22 03:52:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 47, 56, 881354), 1, 2])
securityworker stdout | 2024-04-22 03:52:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:52:57,650 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:52:59,522 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:52:59,588 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:52:59,867 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:52:59,874 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:52:59,876 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:52:59,879 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:52:59,882 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:53:00,569 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:53:00,653 [282] [DEBUG] [app] Starting request: urn:request:2ebfe1c3-3ce6-44ca-8a97-9d653f900c23 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:00,653 [281] [DEBUG] [app] Starting request: urn:request:1a028d9c-558c-4ae5-a81e-f65ba58e3c7b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:00,656 [292] [DEBUG] [app] Starting request: urn:request:7907024f-8414-47f2-80e2-ad15a1335459 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:00,656 [286] [DEBUG] [app] Starting request: urn:request:3616d031-c567-4304-a048-12e5d53202d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [292] [DEBUG] [app] Ending request: urn:request:7907024f-8414-47f2-80e2-ad15a1335459 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7907024f-8414-47f2-80e2-ad15a1335459', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [286] [DEBUG] [app] Ending request: urn:request:3616d031-c567-4304-a048-12e5d53202d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3616d031-c567-4304-a048-12e5d53202d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:00,660 [278] [DEBUG] [app] Starting request: urn:request:0307b274-ae92-42f0-b3c6-3b960168e674 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:00,660 [281] [DEBUG] [app] Starting request: urn:request:ce8ddab5-e0d6-42ca-9264-20fd8abd1b45 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:00,660 [281] [DEBUG] [app] Ending request: urn:request:ce8ddab5-e0d6-42ca-9264-20fd8abd1b45 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ce8ddab5-e0d6-42ca-9264-20fd8abd1b45', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:00,660 [278] [DEBUG] [app] Ending request: urn:request:0307b274-ae92-42f0-b3c6-3b960168e674 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0307b274-ae92-42f0-b3c6-3b960168e674', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:00,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:00,675 [281] [DEBUG] [app] Ending request: urn:request:1a028d9c-558c-4ae5-a81e-f65ba58e3c7b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1a028d9c-558c-4ae5-a81e-f65ba58e3c7b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:53:00,676 [282] [DEBUG] [app] Ending request: urn:request:2ebfe1c3-3ce6-44ca-8a97-9d653f900c23 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ebfe1c3-3ce6-44ca-8a97-9d653f900c23', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:53:02,057 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:16.552337+00:00 (in 13.995602 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:02 UTC)" (scheduled at 2024-04-22 03:53:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:53:03,314 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:53:03,650 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:53:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 03:53:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:13 UTC)" (scheduled at 2024-04-22 03:53:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 3, 760248), True, datetime.datetime(2024, 4, 22, 3, 53, 3, 760248), 0, 'notification/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:53:03,769 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:53:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:53:04,488 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:53:04,491 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:53:04,494 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:53:04,846 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:53:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:26.873109+00:00 (in 21.000691 seconds)
securityworker stdout | 2024-04-22 03:53:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:35 UTC)" (scheduled at 2024-04-22 03:53:05.871852+00:00)
securityworker stdout | 2024-04-22 03:53:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:53:06,032 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:53:06,230 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:53:06,324 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:53:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:53:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:13.555667+00:00 (in 7.002666 seconds)
repositorygcworker stdout | 2024-04-22 03:53:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:06 UTC)" (scheduled at 2024-04-22 03:53:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:53:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:53:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 6, 553408), True, datetime.datetime(2024, 4, 22, 3, 53, 6, 553408), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:53:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:53:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:53:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:53:07,217 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:53:08,550 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:53:08,687 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:53:09,054 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:53:09,135 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:53:10,341 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:53:10,731 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:53:10,737 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:53:10,741 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:53:10,743 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:53:10,747 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:53:10,750 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:53:10,754 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:53:10,757 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:53:10,759 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:53:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:53:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:41.264267+00:00 (in 29.999498 seconds)
autopruneworker stdout | 2024-04-22 03:53:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:41 UTC)" (scheduled at 2024-04-22 03:53:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:53:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757931271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:53:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:53:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:53:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:53:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:06.552482+00:00 (in 52.996257 seconds)
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:13 UTC)" (scheduled at 2024-04-22 03:53:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:19.762160+00:00 (in 6.002273 seconds)
notificationworker stdout | 2024-04-22 03:53:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:23 UTC)" (scheduled at 2024-04-22 03:53:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 13, 760277), True, datetime.datetime(2024, 4, 22, 3, 53, 13, 760277), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:53:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:53:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:44.952062+00:00 (in 29.999520 seconds)
gcworker stdout | 2024-04-22 03:53:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:44 UTC)" (scheduled at 2024-04-22 03:53:14.952062+00:00)
gcworker stdout | 2024-04-22 03:53:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548394952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:53:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:53:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:53:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:53:15,653 [278] [DEBUG] [app] Starting request: urn:request:1e7bd32b-a5c5-40d0-b51d-5b06d1165d67 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:15,653 [282] [DEBUG] [app] Starting request: urn:request:bd76183b-f4c6-463f-b77b-6d463b5748fe (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [290] [DEBUG] [app] Starting request: urn:request:1406cd82-9d3a-4a8e-9acb-27f4748ceef4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [291] [DEBUG] [app] Starting request: urn:request:d289c548-a038-414d-8272-b7cb8bb1c34a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [291] [DEBUG] [app] Ending request: urn:request:d289c548-a038-414d-8272-b7cb8bb1c34a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d289c548-a038-414d-8272-b7cb8bb1c34a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [290] [DEBUG] [app] Ending request: urn:request:1406cd82-9d3a-4a8e-9acb-27f4748ceef4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1406cd82-9d3a-4a8e-9acb-27f4748ceef4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:53:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:53:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:53:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:15,659 [282] [DEBUG] [app] Starting request: urn:request:aa93ec23-d908-4c9c-9dbb-4a21ab9ad57d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:15,660 [282] [DEBUG] [app] Ending request: urn:request:aa93ec23-d908-4c9c-9dbb-4a21ab9ad57d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:aa93ec23-d908-4c9c-9dbb-4a21ab9ad57d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:15,660 [281] [DEBUG] [app] Starting request: urn:request:d31fc86d-e19e-43d9-a3a8-e3d9795be34b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:15,660 [281] [DEBUG] [app] Ending request: urn:request:d31fc86d-e19e-43d9-a3a8-e3d9795be34b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d31fc86d-e19e-43d9-a3a8-e3d9795be34b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:15,674 [282] [DEBUG] [app] Ending request: urn:request:bd76183b-f4c6-463f-b77b-6d463b5748fe (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bd76183b-f4c6-463f-b77b-6d463b5748fe', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:53:15,675 [278] [DEBUG] [app] Ending request: urn:request:1e7bd32b-a5c5-40d0-b51d-5b06d1165d67 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1e7bd32b-a5c5-40d0-b51d-5b06d1165d67', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:53:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:53:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:02.556208+00:00 (in 46.003271 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:16 UTC)" (scheduled at 2024-04-22 03:53:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 16, 553353), True, datetime.datetime(2024, 4, 22, 3, 53, 16, 553353), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:53:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:53:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:47.052354+00:00 (in 29.999400 seconds)
buildlogsarchiver stdout | 2024-04-22 03:53:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:47 UTC)" (scheduled at 2024-04-22 03:53:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:53:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 53, 17, 53322), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:53:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:53:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:53:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:53:19,464 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:53:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:23.759375+00:00 (in 3.996612 seconds)
notificationworker stdout | 2024-04-22 03:53:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:58:19 UTC)" (scheduled at 2024-04-22 03:53:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:53:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 'notification/%'])
notificationworker stdout | 2024-04-22 03:53:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:19 UTC)" (scheduled at 2024-04-22 03:53:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:53:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:53:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), True, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:53:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), True, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 'notification/%'])
notificationworker stdout | 2024-04-22 03:53:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:58:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:53:20,977 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:43.057186+00:00 (in 20.997757 seconds)
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:22 UTC)" (scheduled at 2024-04-22 03:53:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:33.759375+00:00 (in 9.999403 seconds)
notificationworker stdout | 2024-04-22 03:53:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:33 UTC)" (scheduled at 2024-04-22 03:53:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 23, 760418), True, datetime.datetime(2024, 4, 22, 3, 53, 23, 760418), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:24 UTC)" (scheduled at 2024-04-22 03:53:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:53:24,544 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:53:26,207 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:53:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:35.871852+00:00 (in 8.998147 seconds)
securityworker stdout | 2024-04-22 03:53:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:56 UTC)" (scheduled at 2024-04-22 03:53:26.873109+00:00)
securityworker stdout | 2024-04-22 03:53:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:53:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:53:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:53:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 48, 26, 881581), 1, 2])
securityworker stdout | 2024-04-22 03:53:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 48, 26, 881581), 1, 2])
securityworker stdout | 2024-04-22 03:53:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:53:27,670 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:53:29,537 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:53:29,615 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:53:29,876 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:53:29,882 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:53:29,884 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:53:29,887 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:53:29,890 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:53:30,587 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:53:30,653 [282] [DEBUG] [app] Starting request: urn:request:4d7dea9a-9d71-44a2-991d-08d13c4d0c45 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:30,653 [278] [DEBUG] [app] Starting request: urn:request:defde7f9-b494-48d3-bec6-ade506c65627 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:30,656 [284] [DEBUG] [app] Starting request: urn:request:3ab20e64-3819-43a7-9d2a-fa0030be3ec8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:30,656 [290] [DEBUG] [app] Starting request: urn:request:04cda9bb-ae18-4e40-9167-2f03168aeb8a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [290] [DEBUG] [app] Ending request: urn:request:04cda9bb-ae18-4e40-9167-2f03168aeb8a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:04cda9bb-ae18-4e40-9167-2f03168aeb8a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [284] [DEBUG] [app] Ending request: urn:request:3ab20e64-3819-43a7-9d2a-fa0030be3ec8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3ab20e64-3819-43a7-9d2a-fa0030be3ec8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:53:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:30,660 [281] [DEBUG] [app] Starting request: urn:request:9f0ef363-5b0b-48f8-904d-38db676ce927 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:30,660 [278] [DEBUG] [app] Starting request: urn:request:081affe1-8a66-43f5-a8ff-a2ced714314e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:30,660 [281] [DEBUG] [app] Ending request: urn:request:9f0ef363-5b0b-48f8-904d-38db676ce927 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9f0ef363-5b0b-48f8-904d-38db676ce927', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:30,660 [278] [DEBUG] [app] Ending request: urn:request:081affe1-8a66-43f5-a8ff-a2ced714314e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:081affe1-8a66-43f5-a8ff-a2ced714314e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:53:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:30,675 [278] [DEBUG] [app] Ending request: urn:request:defde7f9-b494-48d3-bec6-ade506c65627 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:defde7f9-b494-48d3-bec6-ade506c65627', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 03:53:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:53:30,676 [282] [DEBUG] [app] Ending request: urn:request:4d7dea9a-9d71-44a2-991d-08d13c4d0c45 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4d7dea9a-9d71-44a2-991d-08d13c4d0c45', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:53:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:53:32,085 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:53:33,338 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:53:33,687 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:53:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:43.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 03:53:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:43 UTC)" (scheduled at 2024-04-22 03:53:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 33, 760269), True, datetime.datetime(2024, 4, 22, 3, 53, 33, 760269), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:43 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:53:33,799 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:53:34,496 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:53:34,499 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:53:34,502 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:53:34,882 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:53:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:56.873109+00:00 (in 21.000687 seconds)
securityworker stdout | 2024-04-22 03:53:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:05 UTC)" (scheduled at 2024-04-22 03:53:35.871852+00:00)
securityworker stdout | 2024-04-22 03:53:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:53:36,048 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:53:36,241 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:53:36,348 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:53:37,254 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:53:38,586 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:53:38,715 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:53:39,068 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:53:39,155 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:41.564959+00:00 (in 1.997460 seconds)
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:39 UTC)" (scheduled at 2024-04-22 03:53:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:53:40,364 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:53:40,740 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:53:40,747 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:53:40,749 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:53:40,753 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:53:40,756 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:53:40,759 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:53:40,761 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:53:40,765 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:53:40,767 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:53:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:53:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 03:53:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:11 UTC)" (scheduled at 2024-04-22 03:53:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:53:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757961272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:53:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:53:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:53:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:39.566970+00:00 (in 58.001468 seconds)
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:41 UTC)" (scheduled at 2024-04-22 03:53:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:53:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 41, 565841), True, datetime.datetime(2024, 4, 22, 3, 53, 41, 565841), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:53:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:53:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:53:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:22.058978+00:00 (in 39.001322 seconds)
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:43 UTC)" (scheduled at 2024-04-22 03:53:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:53:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 43, 57944), True, datetime.datetime(2024, 4, 22, 3, 53, 43, 57944), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:53:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:53:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:53:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:53.759375+00:00 (in 9.999487 seconds)
notificationworker stdout | 2024-04-22 03:53:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:53 UTC)" (scheduled at 2024-04-22 03:53:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 43, 760150), True, datetime.datetime(2024, 4, 22, 3, 53, 43, 760150), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:53:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:53:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:14.952062+00:00 (in 29.999537 seconds)
gcworker stdout | 2024-04-22 03:53:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:14 UTC)" (scheduled at 2024-04-22 03:53:44.952062+00:00)
gcworker stdout | 2024-04-22 03:53:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548424952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:53:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:53:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:53:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:53:45,653 [278] [DEBUG] [app] Starting request: urn:request:37b046a1-7b90-47b6-b295-b508d9506f5c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:45,653 [279] [DEBUG] [app] Starting request: urn:request:459efbd3-62ee-4de1-8b63-16d41b379e5f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [284] [DEBUG] [app] Starting request: urn:request:47296da3-55e6-42e0-bdee-9a2b3390cfa7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [290] [DEBUG] [app] Starting request: urn:request:ca61ebee-440e-4229-97e7-cbf63fb75179 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [290] [DEBUG] [app] Ending request: urn:request:ca61ebee-440e-4229-97e7-cbf63fb75179 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ca61ebee-440e-4229-97e7-cbf63fb75179', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [284] [DEBUG] [app] Ending request: urn:request:47296da3-55e6-42e0-bdee-9a2b3390cfa7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47296da3-55e6-42e0-bdee-9a2b3390cfa7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:53:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:53:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:45,659 [278] [DEBUG] [app] Starting request: urn:request:e2fa388e-de16-410a-a590-ce02df97a099 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:45,660 [278] [DEBUG] [app] Ending request: urn:request:e2fa388e-de16-410a-a590-ce02df97a099 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2fa388e-de16-410a-a590-ce02df97a099', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:45,660 [282] [DEBUG] [app] Starting request: urn:request:e7331c95-c7e3-4641-84d7-72f720a7cedb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:45,660 [282] [DEBUG] [app] Ending request: urn:request:e7331c95-c7e3-4641-84d7-72f720a7cedb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e7331c95-c7e3-4641-84d7-72f720a7cedb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:45,674 [278] [DEBUG] [app] Ending request: urn:request:37b046a1-7b90-47b6-b295-b508d9506f5c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:37b046a1-7b90-47b6-b295-b508d9506f5c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:45,675 [279] [DEBUG] [app] Ending request: urn:request:459efbd3-62ee-4de1-8b63-16d41b379e5f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:459efbd3-62ee-4de1-8b63-16d41b379e5f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:53:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:53:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:53:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:17.052354+00:00 (in 29.999415 seconds)
buildlogsarchiver stdout | 2024-04-22 03:53:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:17 UTC)" (scheduled at 2024-04-22 03:53:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:53:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 53, 47, 53497), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:53:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:53:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:53:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:53:49,481 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:53:51,011 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:53:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:03.759375+00:00 (in 9.999464 seconds)
notificationworker stdout | 2024-04-22 03:53:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:03 UTC)" (scheduled at 2024-04-22 03:53:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 53, 760212), True, datetime.datetime(2024, 4, 22, 3, 53, 53, 760212), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:53:54,568 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:53:56,214 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:53:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:05.871852+00:00 (in 8.998157 seconds)
securityworker stdout | 2024-04-22 03:53:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:26 UTC)" (scheduled at 2024-04-22 03:53:56.873109+00:00)
securityworker stdout | 2024-04-22 03:53:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:53:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:53:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:56,881 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:53:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 48, 56, 882444), 1, 2])
securityworker stdout | 2024-04-22 03:53:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:56,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 48, 56, 882444), 1, 2])
securityworker stdout | 2024-04-22 03:53:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:53:57,694 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:53:59,552 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:53:59,649 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:53:59,883 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:53:59,889 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:53:59,892 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:53:59,894 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:53:59,897 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:54:00,614 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:54:00,653 [281] [DEBUG] [app] Starting request: urn:request:12e63eb3-80cc-429f-baf7-82ed071d7f7d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:00,653 [282] [DEBUG] [app] Starting request: urn:request:ec9a9fd3-4489-4e29-9d32-75470a888729 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:00,656 [284] [DEBUG] [app] Starting request: urn:request:cbddb5ff-5943-4057-b1d6-df3e6790169a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [292] [DEBUG] [app] Starting request: urn:request:d1251087-6009-4049-b80c-1352dbf6a768 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [284] [DEBUG] [app] Ending request: urn:request:cbddb5ff-5943-4057-b1d6-df3e6790169a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cbddb5ff-5943-4057-b1d6-df3e6790169a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [292] [DEBUG] [app] Ending request: urn:request:d1251087-6009-4049-b80c-1352dbf6a768 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d1251087-6009-4049-b80c-1352dbf6a768', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:00,659 [281] [DEBUG] [app] Starting request: urn:request:26d160d9-92d7-486f-9013-003d2badf309 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:00,660 [281] [DEBUG] [app] Ending request: urn:request:26d160d9-92d7-486f-9013-003d2badf309 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:26d160d9-92d7-486f-9013-003d2badf309', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:00,660 [278] [DEBUG] [app] Starting request: urn:request:1ace070e-833e-4e77-9dea-78ee1bc97ddf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:00,660 [278] [DEBUG] [app] Ending request: urn:request:1ace070e-833e-4e77-9dea-78ee1bc97ddf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1ace070e-833e-4e77-9dea-78ee1bc97ddf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:54:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:00,675 [281] [DEBUG] [app] Ending request: urn:request:12e63eb3-80cc-429f-baf7-82ed071d7f7d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:12e63eb3-80cc-429f-baf7-82ed071d7f7d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:00,675 [282] [DEBUG] [app] Ending request: urn:request:ec9a9fd3-4489-4e29-9d32-75470a888729 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ec9a9fd3-4489-4e29-9d32-75470a888729', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:54:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:54:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:54:02,113 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:16.552337+00:00 (in 13.995595 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:02 UTC)" (scheduled at 2024-04-22 03:54:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:54:03,363 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:54:03,695 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:54:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:13.759375+00:00 (in 9.999487 seconds)
notificationworker stdout | 2024-04-22 03:54:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:13 UTC)" (scheduled at 2024-04-22 03:54:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 3, 760153), True, datetime.datetime(2024, 4, 22, 3, 54, 3, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:13 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:54:03,836 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:54:04,504 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:54:04,508 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:54:04,511 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:54:04,919 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:54:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:26.873109+00:00 (in 21.000628 seconds)
securityworker stdout | 2024-04-22 03:54:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:35 UTC)" (scheduled at 2024-04-22 03:54:05.871852+00:00)
securityworker stdout | 2024-04-22 03:54:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:54:06,064 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:54:06,256 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:54:06,361 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:54:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:13.555667+00:00 (in 7.002657 seconds)
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:06 UTC)" (scheduled at 2024-04-22 03:54:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 6, 553257), True, datetime.datetime(2024, 4, 22, 3, 54, 6, 553257), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:54:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:54:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:54:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:54:07,290 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
globalpromstats stdout | 2024-04-22 03:54:08,260 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2024-04-22 03:54:08 UTC)" (scheduled at 2024-04-22 03:54:08.260282+00:00)
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [DEBUG] [__main__] Attempting to report stats
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [DEBUG] [util.locking] Acquiring global lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [DEBUG] [redis_lock.acquire] Getting 'lock:GLOBAL_PROM_STATS' ...
globalpromstats stdout | 2024-04-22 03:54:08,262 [69] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:54:08.260282+00:00 (in 3599.998184 seconds)
globalpromstats stdout | 2024-04-22 03:54:08,264 [69] [INFO] [redis_lock.acquire] Got lock for 'lock:GLOBAL_PROM_STATS'.
globalpromstats stdout | 2024-04-22 03:54:08,264 [69] [DEBUG] [util.locking] Acquired lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,264 [69] [DEBUG] [__main__] Reporting global stats
globalpromstats stdout | 2024-04-22 03:54:08,265 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "repository" AS "t1") AS "_wrapped"', [])
globalpromstats stdout | 2024-04-22 03:54:08,275 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))) AS "_wrapped"', [False, False])
globalpromstats stdout | 2024-04-22 03:54:08,279 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."enabled" = %s))) AS "_wrapped"', [True, False, True])
globalpromstats stdout | 2024-04-22 03:54:08,281 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "robotaccounttoken" AS "t1") AS "_wrapped"', [])
globalpromstats stdout | 2024-04-22 03:54:08,283 [69] [DEBUG] [data.database] Disconnecting from database.
globalpromstats stdout | 2024-04-22 03:54:08,283 [69] [DEBUG] [util.locking] Releasing lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,283 [69] [DEBUG] [redis_lock.release] Releasing 'lock:GLOBAL_PROM_STATS'.
globalpromstats stdout | 2024-04-22 03:54:08,284 [69] [DEBUG] [util.locking] Released lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,284 [69] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2024-04-22 04:54:08 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:54:08,623 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:54:08,750 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:54:09,105 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:54:09,179 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:54:10,379 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:54:10,748 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:54:10,757 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:54:10,760 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:54:10,762 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:54:10,766 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:54:10,769 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:54:10,771 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:54:10,776 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:54:10,778 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:54:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:54:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:41.264267+00:00 (in 29.999458 seconds)
autopruneworker stdout | 2024-04-22 03:54:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:41 UTC)" (scheduled at 2024-04-22 03:54:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:54:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757991272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:54:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:54:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:54:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:54:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:06.552482+00:00 (in 52.996309 seconds)
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:13 UTC)" (scheduled at 2024-04-22 03:54:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:54:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:19.762424+00:00 (in 6.002533 seconds)
notificationworker stdout | 2024-04-22 03:54:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:23 UTC)" (scheduled at 2024-04-22 03:54:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 13, 760153), True, datetime.datetime(2024, 4, 22, 3, 54, 13, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:54:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:54:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:44.952062+00:00 (in 29.999490 seconds)
gcworker stdout | 2024-04-22 03:54:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:44 UTC)" (scheduled at 2024-04-22 03:54:14.952062+00:00)
gcworker stdout | 2024-04-22 03:54:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548454952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:54:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:54:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:54:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:54:15,653 [282] [DEBUG] [app] Starting request: urn:request:82799898-1c57-4e5d-956c-977583e119db (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:15,653 [281] [DEBUG] [app] Starting request: urn:request:ef6263c9-2293-465c-9660-fe47a06481f8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:15,656 [291] [DEBUG] [app] Starting request: urn:request:fedb1fad-c09f-4311-997e-e6cecc1b15b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [288] [DEBUG] [app] Starting request: urn:request:5c0eb94a-60e3-4926-b459-551eb6602dbe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [291] [DEBUG] [app] Ending request: urn:request:fedb1fad-c09f-4311-997e-e6cecc1b15b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fedb1fad-c09f-4311-997e-e6cecc1b15b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [288] [DEBUG] [app] Ending request: urn:request:5c0eb94a-60e3-4926-b459-551eb6602dbe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c0eb94a-60e3-4926-b459-551eb6602dbe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:54:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:15,660 [282] [DEBUG] [app] Starting request: urn:request:36927773-fc6f-4354-8209-3f334727d442 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [278] [DEBUG] [app] Starting request: urn:request:741d9adc-d18b-4c74-9493-c5a4fe112fcd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [282] [DEBUG] [app] Ending request: urn:request:36927773-fc6f-4354-8209-3f334727d442 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:36927773-fc6f-4354-8209-3f334727d442', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [278] [DEBUG] [app] Ending request: urn:request:741d9adc-d18b-4c74-9493-c5a4fe112fcd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:741d9adc-d18b-4c74-9493-c5a4fe112fcd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:15,675 [281] [DEBUG] [app] Ending request: urn:request:ef6263c9-2293-465c-9660-fe47a06481f8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ef6263c9-2293-465c-9660-fe47a06481f8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:54:15,681 [282] [DEBUG] [app] Ending request: urn:request:82799898-1c57-4e5d-956c-977583e119db (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:82799898-1c57-4e5d-956c-977583e119db', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:15,681 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:15,681 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.029 118 0.029)
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:02.556208+00:00 (in 46.003255 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:16 UTC)" (scheduled at 2024-04-22 03:54:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 16, 553421), True, datetime.datetime(2024, 4, 22, 3, 54, 16, 553421), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:54:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:54:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:47.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 03:54:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:47 UTC)" (scheduled at 2024-04-22 03:54:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:54:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 54, 17, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:54:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:54:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:54:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:54:19,502 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:54:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:23.759375+00:00 (in 3.996409 seconds)
notificationworker stdout | 2024-04-22 03:54:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:19 UTC)" (scheduled at 2024-04-22 03:54:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:54:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:54:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:54:21,024 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:43.057186+00:00 (in 20.997687 seconds)
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:22 UTC)" (scheduled at 2024-04-22 03:54:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:54:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:33.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 03:54:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:33 UTC)" (scheduled at 2024-04-22 03:54:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 23, 760388), True, datetime.datetime(2024, 4, 22, 3, 54, 23, 760388), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:24.361582+00:00 (in 59.999469 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:24 UTC)" (scheduled at 2024-04-22 03:54:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:54:24,587 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:54:26,251 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:54:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:35.871852+00:00 (in 8.998147 seconds)
securityworker stdout | 2024-04-22 03:54:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:56 UTC)" (scheduled at 2024-04-22 03:54:26.873109+00:00)
securityworker stdout | 2024-04-22 03:54:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:54:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:54:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:26,881 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:54:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 49, 26, 882489), 1, 2])
securityworker stdout | 2024-04-22 03:54:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 49, 26, 882489), 1, 2])
securityworker stdout | 2024-04-22 03:54:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:54:27,731 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:54:29,568 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:54:29,684 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:54:29,890 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:54:29,897 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:54:29,900 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:54:29,902 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:54:29,905 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:54:30,644 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:54:30,653 [282] [DEBUG] [app] Starting request: urn:request:cd7880f7-b949-4f26-9fc4-ff7ba79ea3f2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:30,653 [279] [DEBUG] [app] Starting request: urn:request:46cb1c11-128d-49b8-9181-5bd871239ddf (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [291] [DEBUG] [app] Starting request: urn:request:f0d174cf-baeb-4f02-bb9b-0bf2237239f8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [290] [DEBUG] [app] Starting request: urn:request:714a81fd-25e1-49bc-8c73-818bb3ed401b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [290] [DEBUG] [app] Ending request: urn:request:714a81fd-25e1-49bc-8c73-818bb3ed401b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:714a81fd-25e1-49bc-8c73-818bb3ed401b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [291] [DEBUG] [app] Ending request: urn:request:f0d174cf-baeb-4f02-bb9b-0bf2237239f8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f0d174cf-baeb-4f02-bb9b-0bf2237239f8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:54:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:30,659 [282] [DEBUG] [app] Starting request: urn:request:f35b8b54-ee68-4739-91ae-50bd6a8822ca (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [281] [DEBUG] [app] Starting request: urn:request:a839fbbb-4e0f-4b8e-b3dd-b18b497311f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [282] [DEBUG] [app] Ending request: urn:request:f35b8b54-ee68-4739-91ae-50bd6a8822ca (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f35b8b54-ee68-4739-91ae-50bd6a8822ca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [281] [DEBUG] [app] Ending request: urn:request:a839fbbb-4e0f-4b8e-b3dd-b18b497311f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a839fbbb-4e0f-4b8e-b3dd-b18b497311f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:30,674 [279] [DEBUG] [app] Ending request: urn:request:46cb1c11-128d-49b8-9181-5bd871239ddf (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:46cb1c11-128d-49b8-9181-5bd871239ddf', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:54:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:54:30,676 [282] [DEBUG] [app] Ending request: urn:request:cd7880f7-b949-4f26-9fc4-ff7ba79ea3f2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cd7880f7-b949-4f26-9fc4-ff7ba79ea3f2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:30,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:30,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:54:32,150 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:54:33,392 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:54:33,726 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:54:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:43.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 03:54:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:43 UTC)" (scheduled at 2024-04-22 03:54:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 33, 760205), True, datetime.datetime(2024, 4, 22, 3, 54, 33, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:43 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:54:33,873 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:54:34,512 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:54:34,516 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:54:34,519 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:54:34,955 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:54:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:56.873109+00:00 (in 21.000484 seconds)
securityworker stdout | 2024-04-22 03:54:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:05 UTC)" (scheduled at 2024-04-22 03:54:35.871852+00:00)
securityworker stdout | 2024-04-22 03:54:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:54:36,101 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:54:36,287 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:54:36,397 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:54:37,327 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:54:38,657 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:54:38,757 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:54:39,141 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:54:39,187 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:41.564959+00:00 (in 1.997450 seconds)
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:39 UTC)" (scheduled at 2024-04-22 03:54:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:54:40,415 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:54:40,757 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:54:40,765 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:54:40,767 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:54:40,771 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:54:40,776 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:54:40,780 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:54:40,782 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:54:40,786 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:54:40,788 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:54:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:54:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:11.264267+00:00 (in 29.999495 seconds)
autopruneworker stdout | 2024-04-22 03:54:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:11 UTC)" (scheduled at 2024-04-22 03:54:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:54:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758021271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:54:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:54:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:54:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:39.566970+00:00 (in 58.001515 seconds)
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:41 UTC)" (scheduled at 2024-04-22 03:54:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:54:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 41, 565858), True, datetime.datetime(2024, 4, 22, 3, 54, 41, 565858), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:54:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:54:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:54:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:22.058978+00:00 (in 39.001323 seconds)
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:43 UTC)" (scheduled at 2024-04-22 03:54:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:54:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 43, 57921), True, datetime.datetime(2024, 4, 22, 3, 54, 43, 57921), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:54:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:54:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:54:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:54:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:53.759375+00:00 (in 9.999525 seconds)
notificationworker stdout | 2024-04-22 03:54:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:53 UTC)" (scheduled at 2024-04-22 03:54:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 43, 760101), True, datetime.datetime(2024, 4, 22, 3, 54, 43, 760101), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:54:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:54:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:14.952062+00:00 (in 29.999497 seconds)
gcworker stdout | 2024-04-22 03:54:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:14 UTC)" (scheduled at 2024-04-22 03:54:44.952062+00:00)
gcworker stdout | 2024-04-22 03:54:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548484952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:54:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:54:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:54:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:54:45,653 [278] [DEBUG] [app] Starting request: urn:request:a5b0b7b9-2af4-400b-9cdc-b339257f4c29 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:45,653 [281] [DEBUG] [app] Starting request: urn:request:88d94528-e402-4720-9647-16ead0d897c1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [292] [DEBUG] [app] Starting request: urn:request:8a850807-1a89-4125-bdff-d0bfcbfb2860 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [284] [DEBUG] [app] Starting request: urn:request:c711be6e-d811-4550-bcc6-50366ec55a56 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [292] [DEBUG] [app] Ending request: urn:request:8a850807-1a89-4125-bdff-d0bfcbfb2860 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8a850807-1a89-4125-bdff-d0bfcbfb2860', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [284] [DEBUG] [app] Ending request: urn:request:c711be6e-d811-4550-bcc6-50366ec55a56 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c711be6e-d811-4550-bcc6-50366ec55a56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:45,659 [281] [DEBUG] [app] Starting request: urn:request:13d2eab0-81cf-49d7-b7f9-153d48f0f30d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:45,659 [281] [DEBUG] [app] Ending request: urn:request:13d2eab0-81cf-49d7-b7f9-153d48f0f30d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:13d2eab0-81cf-49d7-b7f9-153d48f0f30d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:45,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,660 [279] [DEBUG] [app] Starting request: urn:request:2bfb8ea0-3257-4451-8ab2-108ae1ad5039 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:45,660 [279] [DEBUG] [app] Ending request: urn:request:2bfb8ea0-3257-4451-8ab2-108ae1ad5039 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2bfb8ea0-3257-4451-8ab2-108ae1ad5039', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:45,665 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:45,673 [281] [DEBUG] [app] Ending request: urn:request:88d94528-e402-4720-9647-16ead0d897c1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:88d94528-e402-4720-9647-16ead0d897c1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:45,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:45,673 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.021 118 0.021)
gunicorn-web stdout | 2024-04-22 03:54:45,674 [278] [DEBUG] [app] Ending request: urn:request:a5b0b7b9-2af4-400b-9cdc-b339257f4c29 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a5b0b7b9-2af4-400b-9cdc-b339257f4c29', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:54:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:54:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:54:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:17.052354+00:00 (in 29.999401 seconds)
buildlogsarchiver stdout | 2024-04-22 03:54:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:17 UTC)" (scheduled at 2024-04-22 03:54:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:54:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 54, 47, 53360), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:54:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:54:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:54:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:54:49,520 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:54:51,032 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:54:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:03.759375+00:00 (in 9.999504 seconds)
notificationworker stdout | 2024-04-22 03:54:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:03 UTC)" (scheduled at 2024-04-22 03:54:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 53, 760209), True, datetime.datetime(2024, 4, 22, 3, 54, 53, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:54:54,616 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:54:56,287 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:54:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:05.871852+00:00 (in 8.998141 seconds)
securityworker stdout | 2024-04-22 03:54:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:26 UTC)" (scheduled at 2024-04-22 03:54:56.873109+00:00)
securityworker stdout | 2024-04-22 03:54:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:54:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:54:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 49, 56, 881305), 1, 2])
securityworker stdout | 2024-04-22 03:54:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 49, 56, 881305), 1, 2])
securityworker stdout | 2024-04-22 03:54:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:54:57,767 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:54:59,604 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:54:59,721 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:54:59,898 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:54:59,906 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:54:59,908 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:54:59,911 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:54:59,913 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:55:00,653 [281] [DEBUG] [app] Starting request: urn:request:780aa401-fcd0-4e33-9c20-7c3fed7bb6f7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:00,653 [278] [DEBUG] [app] Starting request: urn:request:2ff32165-fc15-43a8-943a-e99bce318f7d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [284] [DEBUG] [app] Starting request: urn:request:a1f308a3-7232-495a-98e6-c26c8d2024da (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [284] [DEBUG] [app] Ending request: urn:request:a1f308a3-7232-495a-98e6-c26c8d2024da (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1f308a3-7232-495a-98e6-c26c8d2024da', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [292] [DEBUG] [app] Starting request: urn:request:55af4a90-dd87-4ddd-80ac-ab2e66ba97af (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:55:00,657 [292] [DEBUG] [app] Ending request: urn:request:55af4a90-dd87-4ddd-80ac-ab2e66ba97af (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:55af4a90-dd87-4ddd-80ac-ab2e66ba97af', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:00,659 [279] [DEBUG] [app] Starting request: urn:request:f310d583-ee6f-4a1e-8a6f-5534dfc30a4d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:00,659 [279] [DEBUG] [app] Ending request: urn:request:f310d583-ee6f-4a1e-8a6f-5534dfc30a4d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f310d583-ee6f-4a1e-8a6f-5534dfc30a4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:55:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:00,660 [282] [DEBUG] [app] Starting request: urn:request:40bd1da7-bc8c-46e1-b610-6cb577a33c82 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:00,660 [282] [DEBUG] [app] Ending request: urn:request:40bd1da7-bc8c-46e1-b610-6cb577a33c82 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:40bd1da7-bc8c-46e1-b610-6cb577a33c82', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:55:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:00,674 [281] [DEBUG] [app] Ending request: urn:request:780aa401-fcd0-4e33-9c20-7c3fed7bb6f7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:780aa401-fcd0-4e33-9c20-7c3fed7bb6f7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:00,675 [278] [DEBUG] [app] Ending request: urn:request:2ff32165-fc15-43a8-943a-e99bce318f7d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ff32165-fc15-43a8-943a-e99bce318f7d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:55:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:55:00,679 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:55:02,158 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:16.552337+00:00 (in 13.995577 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:02 UTC)" (scheduled at 2024-04-22 03:55:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:55:03,415 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:55:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:13.759375+00:00 (in 9.999513 seconds)
notificationworker stdout | 2024-04-22 03:55:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:13 UTC)" (scheduled at 2024-04-22 03:55:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 3, 760122), True, datetime.datetime(2024, 4, 22, 3, 55, 3, 760122), 0, 'notification/%', 50, 1, 0])
gcworker stdout | 2024-04-22 03:55:03,762 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:55:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:13 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:55:03,909 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:55:04,519 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:55:04,524 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:55:04,527 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:55:04,992 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:55:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:26.873109+00:00 (in 21.000645 seconds)
securityworker stdout | 2024-04-22 03:55:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:35 UTC)" (scheduled at 2024-04-22 03:55:05.871852+00:00)
securityworker stdout | 2024-04-22 03:55:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:55:06,138 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:55:06,300 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:55:06,433 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:55:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:55:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:13.555667+00:00 (in 7.002673 seconds)
repositorygcworker stdout | 2024-04-22 03:55:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:06 UTC)" (scheduled at 2024-04-22 03:55:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:55:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:55:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 6, 553284), True, datetime.datetime(2024, 4, 22, 3, 55, 6, 553284), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:55:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:55:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:55:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:55:07,350 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:55:08,693 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:55:08,794 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:55:09,168 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:55:09,204 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:55:10,452 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:55:10,770 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:55:10,773 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:55:10,779 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:55:10,782 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:55:10,786 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:55:10,789 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:55:10,791 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:55:10,795 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:55:10,797 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:55:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:55:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:55:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:41 UTC)" (scheduled at 2024-04-22 03:55:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:55:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758051271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:55:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:55:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:55:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:55:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:06.552482+00:00 (in 52.996271 seconds)
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:13 UTC)" (scheduled at 2024-04-22 03:55:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:55:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:19.762424+00:00 (in 6.002562 seconds)
notificationworker stdout | 2024-04-22 03:55:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:23 UTC)" (scheduled at 2024-04-22 03:55:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 13, 760118), True, datetime.datetime(2024, 4, 22, 3, 55, 13, 760118), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:55:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:55:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:44.952062+00:00 (in 29.999526 seconds)
gcworker stdout | 2024-04-22 03:55:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:44 UTC)" (scheduled at 2024-04-22 03:55:14.952062+00:00)
gcworker stdout | 2024-04-22 03:55:14,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 03:55:14,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548514962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:55:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:55:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:55:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:55:15,652 [282] [DEBUG] [app] Starting request: urn:request:c533a30b-d27b-433f-8415-3a658bcf5603 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:15,652 [278] [DEBUG] [app] Starting request: urn:request:a9c01b92-ab75-4442-8b1c-09187819b145 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:15,655 [291] [DEBUG] [app] Starting request: urn:request:81dea8d0-6e33-4ebb-bdcd-33f373f2bc0c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:15,655 [284] [DEBUG] [app] Starting request: urn:request:74cae8db-c0ac-410b-86ee-cdd2b0751a89 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [291] [DEBUG] [app] Ending request: urn:request:81dea8d0-6e33-4ebb-bdcd-33f373f2bc0c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:81dea8d0-6e33-4ebb-bdcd-33f373f2bc0c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [284] [DEBUG] [app] Ending request: urn:request:74cae8db-c0ac-410b-86ee-cdd2b0751a89 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:74cae8db-c0ac-410b-86ee-cdd2b0751a89', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:15,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,657 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:15,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [DEBUG] [app] Starting request: urn:request:1f531983-be0f-490b-b6eb-f92220c0daa1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [281] [DEBUG] [app] Starting request: urn:request:f7f2536a-ba4a-4ce1-a562-7b26672d7d5a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [DEBUG] [app] Ending request: urn:request:1f531983-be0f-490b-b6eb-f92220c0daa1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1f531983-be0f-490b-b6eb-f92220c0daa1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [281] [DEBUG] [app] Ending request: urn:request:f7f2536a-ba4a-4ce1-a562-7b26672d7d5a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f7f2536a-ba4a-4ce1-a562-7b26672d7d5a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:15,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:15,673 [278] [DEBUG] [app] Ending request: urn:request:a9c01b92-ab75-4442-8b1c-09187819b145 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a9c01b92-ab75-4442-8b1c-09187819b145', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:15,673 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:55:15,674 [282] [DEBUG] [app] Ending request: urn:request:c533a30b-d27b-433f-8415-3a658bcf5603 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c533a30b-d27b-433f-8415-3a658bcf5603', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:55:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:02.556208+00:00 (in 46.003288 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:16 UTC)" (scheduled at 2024-04-22 03:55:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 16, 553353), True, datetime.datetime(2024, 4, 22, 3, 55, 16, 553353), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:55:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:55:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:47.052354+00:00 (in 29.999406 seconds)
buildlogsarchiver stdout | 2024-04-22 03:55:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:47 UTC)" (scheduled at 2024-04-22 03:55:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:55:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 55, 17, 53205), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:55:17,071 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:55:17,071 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:55:17,071 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:55:19,557 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:55:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:23.759375+00:00 (in 3.996447 seconds)
notificationworker stdout | 2024-04-22 03:55:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:19 UTC)" (scheduled at 2024-04-22 03:55:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:55:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:55:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:55:21,057 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:43.057186+00:00 (in 20.997721 seconds)
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:22 UTC)" (scheduled at 2024-04-22 03:55:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:55:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:33.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 03:55:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:33 UTC)" (scheduled at 2024-04-22 03:55:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 23, 760279), True, datetime.datetime(2024, 4, 22, 3, 55, 23, 760279), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:24.361582+00:00 (in 59.999481 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:24 UTC)" (scheduled at 2024-04-22 03:55:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:55:24,643 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:55:26,311 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:55:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:35.871852+00:00 (in 8.998145 seconds)
securityworker stdout | 2024-04-22 03:55:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:56 UTC)" (scheduled at 2024-04-22 03:55:26.873109+00:00)
securityworker stdout | 2024-04-22 03:55:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:55:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:55:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:55:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 50, 26, 881474), 1, 2])
securityworker stdout | 2024-04-22 03:55:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 50, 26, 881474), 1, 2])
securityworker stdout | 2024-04-22 03:55:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:55:27,776 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:55:29,614 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:55:29,757 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:55:29,908 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:55:29,913 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:55:29,915 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:55:29,918 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:55:29,920 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:55:30,653 [282] [DEBUG] [app] Starting request: urn:request:0b40e6ec-5fbf-414b-bd5d-35eb8a1373ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:30,653 [278] [DEBUG] [app] Starting request: urn:request:0aa717d4-6bd4-4603-a48f-7ac2fd95622f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:30,656 [291] [DEBUG] [app] Starting request: urn:request:b8585883-d716-4b9e-97c0-4aac94bdb332 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [292] [DEBUG] [app] Starting request: urn:request:4892994a-6344-4670-810f-479eba2f21ec (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [291] [DEBUG] [app] Ending request: urn:request:b8585883-d716-4b9e-97c0-4aac94bdb332 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b8585883-d716-4b9e-97c0-4aac94bdb332', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [292] [DEBUG] [app] Ending request: urn:request:4892994a-6344-4670-810f-479eba2f21ec (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4892994a-6344-4670-810f-479eba2f21ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [DEBUG] [app] Starting request: urn:request:c92f48c1-d4ab-40ef-bc64-e3854aa5eff2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [DEBUG] [app] Ending request: urn:request:c92f48c1-d4ab-40ef-bc64-e3854aa5eff2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c92f48c1-d4ab-40ef-bc64-e3854aa5eff2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:30,660 [281] [DEBUG] [app] Starting request: urn:request:6230ca6d-a120-42fc-94d0-c59f3cfa1307 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:30,661 [281] [DEBUG] [app] Ending request: urn:request:6230ca6d-a120-42fc-94d0-c59f3cfa1307 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6230ca6d-a120-42fc-94d0-c59f3cfa1307', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:30,674 [282] [DEBUG] [app] Ending request: urn:request:0b40e6ec-5fbf-414b-bd5d-35eb8a1373ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0b40e6ec-5fbf-414b-bd5d-35eb8a1373ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:55:30,675 [278] [DEBUG] [app] Ending request: urn:request:0aa717d4-6bd4-4603-a48f-7ac2fd95622f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0aa717d4-6bd4-4603-a48f-7ac2fd95622f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:55:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:55:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 03:55:30,707 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:55:32,191 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:55:33,452 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:55:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:43.759375+00:00 (in 9.999439 seconds)
notificationworker stdout | 2024-04-22 03:55:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:43 UTC)" (scheduled at 2024-04-22 03:55:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 33, 760279), True, datetime.datetime(2024, 4, 22, 3, 55, 33, 760279), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:55:33,798 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:55:33,928 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:55:34,526 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:55:34,533 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:55:34,535 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:55:35,027 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:55:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:56.873109+00:00 (in 21.000630 seconds)
securityworker stdout | 2024-04-22 03:55:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:05 UTC)" (scheduled at 2024-04-22 03:55:35.871852+00:00)
securityworker stdout | 2024-04-22 03:55:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:55:36,174 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:55:36,337 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:55:36,460 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:55:37,366 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:55:38,729 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:55:38,803 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:55:39,184 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:55:39,218 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:41.564959+00:00 (in 1.997464 seconds)
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:39 UTC)" (scheduled at 2024-04-22 03:55:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:55:40,469 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:55:40,781 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:55:40,784 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:55:40,788 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:55:40,790 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:55:40,797 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:55:40,800 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:55:40,803 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:55:40,805 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:55:40,808 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:55:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:55:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:11.264267+00:00 (in 29.999467 seconds)
autopruneworker stdout | 2024-04-22 03:55:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:11 UTC)" (scheduled at 2024-04-22 03:55:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:55:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758081271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:55:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:55:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:55:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:39.566970+00:00 (in 58.001472 seconds)
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:41 UTC)" (scheduled at 2024-04-22 03:55:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:55:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 41, 565775), True, datetime.datetime(2024, 4, 22, 3, 55, 41, 565775), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:55:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:55:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:55:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:22.058978+00:00 (in 39.001304 seconds)
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:43 UTC)" (scheduled at 2024-04-22 03:55:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:55:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 43, 57995), True, datetime.datetime(2024, 4, 22, 3, 55, 43, 57995), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:55:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:55:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:55:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:55:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:53.759375+00:00 (in 9.999477 seconds)
notificationworker stdout | 2024-04-22 03:55:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:53 UTC)" (scheduled at 2024-04-22 03:55:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 43, 760289), True, datetime.datetime(2024, 4, 22, 3, 55, 43, 760289), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:55:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:55:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:14.952062+00:00 (in 29.999527 seconds)
gcworker stdout | 2024-04-22 03:55:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:14 UTC)" (scheduled at 2024-04-22 03:55:44.952062+00:00)
gcworker stdout | 2024-04-22 03:55:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548544952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:55:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:55:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:55:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:55:45,653 [282] [DEBUG] [app] Starting request: urn:request:d87b8010-adf1-4cb8-976e-1f09e451f3ac (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:45,653 [278] [DEBUG] [app] Starting request: urn:request:bac9fbd1-b937-487a-8439-9f85889618c5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:45,656 [292] [DEBUG] [app] Starting request: urn:request:5bdb1951-9e99-4656-8b33-c911711e4863 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:45,656 [291] [DEBUG] [app] Starting request: urn:request:fdad24aa-bbaa-4781-ab02-8326b6911dc2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:45,656 [292] [DEBUG] [app] Ending request: urn:request:5bdb1951-9e99-4656-8b33-c911711e4863 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5bdb1951-9e99-4656-8b33-c911711e4863', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:45,657 [291] [DEBUG] [app] Ending request: urn:request:fdad24aa-bbaa-4781-ab02-8326b6911dc2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fdad24aa-bbaa-4781-ab02-8326b6911dc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:55:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:45,659 [278] [DEBUG] [app] Starting request: urn:request:3ab27539-dafc-4a4c-8056-f7599321cf77 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:45,659 [282] [DEBUG] [app] Starting request: urn:request:a3386b9a-5c6e-45fa-b0a3-427af71ad521 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [DEBUG] [app] Ending request: urn:request:3ab27539-dafc-4a4c-8056-f7599321cf77 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3ab27539-dafc-4a4c-8056-f7599321cf77', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:45,660 [282] [DEBUG] [app] Ending request: urn:request:a3386b9a-5c6e-45fa-b0a3-427af71ad521 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a3386b9a-5c6e-45fa-b0a3-427af71ad521', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:45,674 [282] [DEBUG] [app] Ending request: urn:request:d87b8010-adf1-4cb8-976e-1f09e451f3ac (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d87b8010-adf1-4cb8-976e-1f09e451f3ac', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:45,674 [278] [DEBUG] [app] Ending request: urn:request:bac9fbd1-b937-487a-8439-9f85889618c5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bac9fbd1-b937-487a-8439-9f85889618c5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:55:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:55:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:55:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:17.052354+00:00 (in 29.999410 seconds)
buildlogsarchiver stdout | 2024-04-22 03:55:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:17 UTC)" (scheduled at 2024-04-22 03:55:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:55:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 55, 47, 53224), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:55:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:55:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:55:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:55:49,568 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:55:51,090 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:55:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:03.759375+00:00 (in 9.999438 seconds)
notificationworker stdout | 2024-04-22 03:55:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:03 UTC)" (scheduled at 2024-04-22 03:55:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 53, 760292), True, datetime.datetime(2024, 4, 22, 3, 55, 53, 760292), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:55:54,678 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:55:56,342 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:55:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:05.871852+00:00 (in 8.998193 seconds)
securityworker stdout | 2024-04-22 03:55:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:26 UTC)" (scheduled at 2024-04-22 03:55:56.873109+00:00)
securityworker stdout | 2024-04-22 03:55:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:55:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:55:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:56,906 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:55:56,908 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:56,908 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:56,909 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 50, 56, 881595), 1, 2])
securityworker stdout | 2024-04-22 03:55:56,911 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:56,911 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:56,912 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 50, 56, 881595), 1, 2])
securityworker stdout | 2024-04-22 03:55:56,914 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:56,914 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:56,915 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,915 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:56,915 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:55:57,808 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:55:59,651 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:55:59,794 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:55:59,915 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:55:59,920 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:55:59,922 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:55:59,925 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:55:59,927 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:56:00,653 [282] [DEBUG] [app] Starting request: urn:request:4c787391-7ebe-4630-8476-b83eb4e2d297 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:00,653 [278] [DEBUG] [app] Starting request: urn:request:4d836aae-e6d2-4493-be4a-5aa8ee73d37a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:00,656 [292] [DEBUG] [app] Starting request: urn:request:7311752f-ae40-4a63-8e7e-24800d9b45ea (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:00,656 [292] [DEBUG] [app] Ending request: urn:request:7311752f-ae40-4a63-8e7e-24800d9b45ea (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7311752f-ae40-4a63-8e7e-24800d9b45ea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:00,656 [284] [DEBUG] [app] Starting request: urn:request:74b40456-6550-4b99-aa07-b2288d684e8e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:00,657 [284] [DEBUG] [app] Ending request: urn:request:74b40456-6550-4b99-aa07-b2288d684e8e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:74b40456-6550-4b99-aa07-b2288d684e8e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:56:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:56:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:00,659 [282] [DEBUG] [app] Starting request: urn:request:77ef5e73-e4a5-4eaf-8243-3add891e3328 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [DEBUG] [app] Ending request: urn:request:77ef5e73-e4a5-4eaf-8243-3add891e3328 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:77ef5e73-e4a5-4eaf-8243-3add891e3328', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:00,660 [281] [DEBUG] [app] Starting request: urn:request:1f413036-cbee-43f5-8919-57307c12c379 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:00,661 [281] [DEBUG] [app] Ending request: urn:request:1f413036-cbee-43f5-8919-57307c12c379 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1f413036-cbee-43f5-8919-57307c12c379', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:00,675 [282] [DEBUG] [app] Ending request: urn:request:4c787391-7ebe-4630-8476-b83eb4e2d297 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4c787391-7ebe-4630-8476-b83eb4e2d297', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:56:00,675 [278] [DEBUG] [app] Ending request: urn:request:4d836aae-e6d2-4493-be4a-5aa8ee73d37a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4d836aae-e6d2-4493-be4a-5aa8ee73d37a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 03:56:00,743 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:56:02,227 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:16.552337+00:00 (in 13.995586 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:02 UTC)" (scheduled at 2024-04-22 03:56:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:56:03,488 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:56:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:13.759375+00:00 (in 9.999480 seconds)
notificationworker stdout | 2024-04-22 03:56:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:13 UTC)" (scheduled at 2024-04-22 03:56:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 3, 760321), True, datetime.datetime(2024, 4, 22, 3, 56, 3, 760321), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:03,815 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:56:03,956 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:56:04,534 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:56:04,539 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:56:04,542 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:56:05,063 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:56:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:26.873109+00:00 (in 21.000753 seconds)
securityworker stdout | 2024-04-22 03:56:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:35 UTC)" (scheduled at 2024-04-22 03:56:05.871852+00:00)
securityworker stdout | 2024-04-22 03:56:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:56:06,207 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:56:06,371 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:56:06,467 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:56:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:56:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:13.555667+00:00 (in 7.002683 seconds)
repositorygcworker stdout | 2024-04-22 03:56:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:06 UTC)" (scheduled at 2024-04-22 03:56:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:56:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:56:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 6, 553227), True, datetime.datetime(2024, 4, 22, 3, 56, 6, 553227), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:56:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:56:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:56:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:56:07,403 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:56:08,767 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:56:08,838 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:56:09,201 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:56:09,253 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:56:10,500 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:56:10,794 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:56:10,797 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:56:10,800 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:56:10,802 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:56:10,807 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:56:10,811 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:56:10,815 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:56:10,818 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:56:10,820 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:56:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:56:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:41.264267+00:00 (in 29.999453 seconds)
autopruneworker stdout | 2024-04-22 03:56:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:41 UTC)" (scheduled at 2024-04-22 03:56:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:56:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758111271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:56:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:56:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:56:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:56:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:51.555445+00:00 (in 37.999268 seconds)
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:13 UTC)" (scheduled at 2024-04-22 03:56:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:19.762424+00:00 (in 6.002583 seconds)
notificationworker stdout | 2024-04-22 03:56:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:23 UTC)" (scheduled at 2024-04-22 03:56:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 13, 760142), True, datetime.datetime(2024, 4, 22, 3, 56, 13, 760142), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:56:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:44.952062+00:00 (in 29.999536 seconds)
gcworker stdout | 2024-04-22 03:56:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:44 UTC)" (scheduled at 2024-04-22 03:56:14.952062+00:00)
gcworker stdout | 2024-04-22 03:56:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548574952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:56:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:56:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:56:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:56:15,653 [279] [DEBUG] [app] Starting request: urn:request:247bf856-442f-467a-86d0-083b6fb532f6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:15,653 [278] [DEBUG] [app] Starting request: urn:request:929a560f-9a11-497c-a1f4-66067fb28c3e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [284] [DEBUG] [app] Starting request: urn:request:60d3f54e-a17b-4ff6-b2a9-5ef192027cf5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [291] [DEBUG] [app] Starting request: urn:request:e541570b-f238-4e84-8d2f-7731471aa4d1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [284] [DEBUG] [app] Ending request: urn:request:60d3f54e-a17b-4ff6-b2a9-5ef192027cf5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:60d3f54e-a17b-4ff6-b2a9-5ef192027cf5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [291] [DEBUG] [app] Ending request: urn:request:e541570b-f238-4e84-8d2f-7731471aa4d1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e541570b-f238-4e84-8d2f-7731471aa4d1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:56:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:56:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:15,659 [278] [DEBUG] [app] Starting request: urn:request:c3cf06de-437a-45a4-9438-9b503d8177ec (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:15,659 [278] [DEBUG] [app] Ending request: urn:request:c3cf06de-437a-45a4-9438-9b503d8177ec (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c3cf06de-437a-45a4-9438-9b503d8177ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:15,660 [282] [DEBUG] [app] Starting request: urn:request:2defd9d8-d110-450f-b1a2-ff4e1db4108e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,660 [282] [DEBUG] [app] Ending request: urn:request:2defd9d8-d110-450f-b1a2-ff4e1db4108e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2defd9d8-d110-450f-b1a2-ff4e1db4108e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:15,674 [278] [DEBUG] [app] Ending request: urn:request:929a560f-9a11-497c-a1f4-66067fb28c3e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:929a560f-9a11-497c-a1f4-66067fb28c3e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:56:15,675 [279] [DEBUG] [app] Ending request: urn:request:247bf856-442f-467a-86d0-083b6fb532f6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:247bf856-442f-467a-86d0-083b6fb532f6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:02.556208+00:00 (in 46.003282 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:16 UTC)" (scheduled at 2024-04-22 03:56:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 16, 553340), True, datetime.datetime(2024, 4, 22, 3, 56, 16, 553340), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:56:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:56:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:47.052354+00:00 (in 29.999418 seconds)
buildlogsarchiver stdout | 2024-04-22 03:56:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:47 UTC)" (scheduled at 2024-04-22 03:56:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:56:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 56, 17, 53155), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:56:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:56:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:56:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:56:19,581 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:56:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:23.759375+00:00 (in 3.996459 seconds)
notificationworker stdout | 2024-04-22 03:56:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:19 UTC)" (scheduled at 2024-04-22 03:56:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:56:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:56:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:56:21,104 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:43.057186+00:00 (in 20.997639 seconds)
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:22 UTC)" (scheduled at 2024-04-22 03:56:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:33.759375+00:00 (in 9.999449 seconds)
notificationworker stdout | 2024-04-22 03:56:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:33 UTC)" (scheduled at 2024-04-22 03:56:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 23, 760374), True, datetime.datetime(2024, 4, 22, 3, 56, 23, 760374), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:24.361582+00:00 (in 59.999458 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:24 UTC)" (scheduled at 2024-04-22 03:56:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:56:24,714 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:56:26,370 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:56:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:35.871852+00:00 (in 8.998258 seconds)
securityworker stdout | 2024-04-22 03:56:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:56 UTC)" (scheduled at 2024-04-22 03:56:26.873109+00:00)
securityworker stdout | 2024-04-22 03:56:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:56:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:56:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:56:26,902 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:26,902 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:26,903 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 51, 26, 882113), 1, 2])
securityworker stdout | 2024-04-22 03:56:26,905 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:26,905 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:26,906 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 51, 26, 882113), 1, 2])
securityworker stdout | 2024-04-22 03:56:26,908 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:26,908 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:26,908 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,908 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:56:26,908 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:26,910 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:56:27,844 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:56:29,686 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:56:29,830 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:56:29,923 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:56:29,926 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:56:29,929 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:56:29,932 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:56:29,934 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:56:30,653 [278] [DEBUG] [app] Starting request: urn:request:b3bd842d-f62e-4604-84b2-6013d26c4a8b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:30,653 [279] [DEBUG] [app] Starting request: urn:request:8fca6b0e-9fe6-40be-b05d-98c4e9df8ef0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:30,656 [290] [DEBUG] [app] Starting request: urn:request:4205299e-7ae7-4797-8faf-8bda77682bdd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [290] [DEBUG] [app] Ending request: urn:request:4205299e-7ae7-4797-8faf-8bda77682bdd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4205299e-7ae7-4797-8faf-8bda77682bdd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:30,656 [284] [DEBUG] [app] Starting request: urn:request:4fd90c53-2a0c-40dc-8e97-f5d5ced42ad3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [284] [DEBUG] [app] Ending request: urn:request:4fd90c53-2a0c-40dc-8e97-f5d5ced42ad3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4fd90c53-2a0c-40dc-8e97-f5d5ced42ad3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:56:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:30,659 [278] [DEBUG] [app] Starting request: urn:request:526fa25d-42d8-45b7-844d-611543b59db8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [DEBUG] [app] Ending request: urn:request:526fa25d-42d8-45b7-844d-611543b59db8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:526fa25d-42d8-45b7-844d-611543b59db8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:30,660 [282] [DEBUG] [app] Starting request: urn:request:954ddd17-edd1-46c0-a1fb-1f8c5f3a7b76 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [282] [DEBUG] [app] Ending request: urn:request:954ddd17-edd1-46c0-a1fb-1f8c5f3a7b76 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:954ddd17-edd1-46c0-a1fb-1f8c5f3a7b76', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:30,674 [278] [DEBUG] [app] Ending request: urn:request:b3bd842d-f62e-4604-84b2-6013d26c4a8b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b3bd842d-f62e-4604-84b2-6013d26c4a8b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:30,675 [279] [DEBUG] [app] Ending request: urn:request:8fca6b0e-9fe6-40be-b05d-98c4e9df8ef0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8fca6b0e-9fe6-40be-b05d-98c4e9df8ef0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:56:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:56:30,761 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:56:32,264 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:56:33,520 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:56:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:43.759375+00:00 (in 9.999450 seconds)
notificationworker stdout | 2024-04-22 03:56:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:43 UTC)" (scheduled at 2024-04-22 03:56:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 33, 760236), True, datetime.datetime(2024, 4, 22, 3, 56, 33, 760236), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:33,849 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:56:33,976 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:56:34,542 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:56:34,547 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:56:34,550 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:56:35,082 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:56:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:56.873109+00:00 (in 21.000699 seconds)
securityworker stdout | 2024-04-22 03:56:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:05 UTC)" (scheduled at 2024-04-22 03:56:35.871852+00:00)
securityworker stdout | 2024-04-22 03:56:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:56:36,240 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:56:36,400 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:56:36,475 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:56:37,439 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:56:38,804 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:56:38,856 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:56:39,208 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:56:39,282 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:41.564959+00:00 (in 1.997425 seconds)
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:39 UTC)" (scheduled at 2024-04-22 03:56:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:56:40,526 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:56:40,805 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:56:40,809 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:56:40,811 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:56:40,814 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:56:40,818 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:56:40,822 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:56:40,825 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:56:40,828 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:56:40,831 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:56:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:56:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:11.264267+00:00 (in 29.999465 seconds)
autopruneworker stdout | 2024-04-22 03:56:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:11 UTC)" (scheduled at 2024-04-22 03:56:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:56:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758141271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:56:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:56:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:56:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:53.566665+00:00 (in 12.001184 seconds)
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:41 UTC)" (scheduled at 2024-04-22 03:56:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:56:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 41, 565767), True, datetime.datetime(2024, 4, 22, 3, 56, 41, 565767), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:56:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:56:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:56:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:22.058978+00:00 (in 39.001297 seconds)
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:43 UTC)" (scheduled at 2024-04-22 03:56:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:56:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 43, 57965), True, datetime.datetime(2024, 4, 22, 3, 56, 43, 57965), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:56:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:56:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:56:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:53.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 03:56:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:53 UTC)" (scheduled at 2024-04-22 03:56:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 43, 760299), True, datetime.datetime(2024, 4, 22, 3, 56, 43, 760299), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:56:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:14.952062+00:00 (in 29.999518 seconds)
gcworker stdout | 2024-04-22 03:56:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:14 UTC)" (scheduled at 2024-04-22 03:56:44.952062+00:00)
gcworker stdout | 2024-04-22 03:56:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548604952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:56:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:56:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:56:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:56:45,653 [282] [DEBUG] [app] Starting request: urn:request:3be8e5d5-6b78-44e0-94d6-98c56103ce1f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:45,653 [281] [DEBUG] [app] Starting request: urn:request:090308c6-4f49-4d22-9c87-9decf6b7b828 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:45,656 [290] [DEBUG] [app] Starting request: urn:request:c011c834-6639-496c-960e-f4d909b55e6a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:45,656 [292] [DEBUG] [app] Starting request: urn:request:79fd087f-a740-4eb7-af69-c5f80695ba8f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [290] [DEBUG] [app] Ending request: urn:request:c011c834-6639-496c-960e-f4d909b55e6a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c011c834-6639-496c-960e-f4d909b55e6a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [292] [DEBUG] [app] Ending request: urn:request:79fd087f-a740-4eb7-af69-c5f80695ba8f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:79fd087f-a740-4eb7-af69-c5f80695ba8f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [DEBUG] [app] Starting request: urn:request:677b757a-eea5-442f-a74a-30b1d5062416 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [DEBUG] [app] Ending request: urn:request:677b757a-eea5-442f-a74a-30b1d5062416 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:677b757a-eea5-442f-a74a-30b1d5062416', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [278] [DEBUG] [app] Starting request: urn:request:0816e0ef-7097-4f9f-ae94-15844d965cdd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:45,660 [278] [DEBUG] [app] Ending request: urn:request:0816e0ef-7097-4f9f-ae94-15844d965cdd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0816e0ef-7097-4f9f-ae94-15844d965cdd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:45,675 [281] [DEBUG] [app] Ending request: urn:request:090308c6-4f49-4d22-9c87-9decf6b7b828 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:090308c6-4f49-4d22-9c87-9decf6b7b828', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:45,676 [282] [DEBUG] [app] Ending request: urn:request:3be8e5d5-6b78-44e0-94d6-98c56103ce1f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3be8e5d5-6b78-44e0-94d6-98c56103ce1f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:45,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:56:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:56:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:17.052354+00:00 (in 29.999486 seconds)
buildlogsarchiver stdout | 2024-04-22 03:56:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:17 UTC)" (scheduled at 2024-04-22 03:56:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:56:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 56, 47, 53093), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:56:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:56:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:56:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:56:49,615 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:56:51,124 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:56:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:56:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:06.552482+00:00 (in 14.996487 seconds)
repositorygcworker stdout | 2024-04-22 03:56:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:51 UTC)" (scheduled at 2024-04-22 03:56:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:56:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:56:51,568 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), True, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:56:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), True, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:56:51,573 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:56:51,573 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:56:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:56:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:39.566970+00:00 (in 45.999754 seconds)
exportactionlogsworker stdout | 2024-04-22 03:56:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:53 UTC)" (scheduled at 2024-04-22 03:56:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:56:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:56:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), True, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:56:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), True, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:56:53,583 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:56:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:03.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 03:56:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:03 UTC)" (scheduled at 2024-04-22 03:56:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 53, 760244), True, datetime.datetime(2024, 4, 22, 3, 56, 53, 760244), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:56:54,750 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:56:56,395 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:56:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:05.871852+00:00 (in 8.998237 seconds)
securityworker stdout | 2024-04-22 03:56:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:26 UTC)" (scheduled at 2024-04-22 03:56:56.873109+00:00)
securityworker stdout | 2024-04-22 03:56:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:56:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:56:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:56:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 51, 56, 882109), 1, 2])
securityworker stdout | 2024-04-22 03:56:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 51, 56, 882109), 1, 2])
securityworker stdout | 2024-04-22 03:56:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:56:57,852 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:56:59,711 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:56:59,866 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:56:59,932 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:56:59,937 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:56:59,939 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:56:59,942 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:56:59,944 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:57:00,652 [278] [DEBUG] [app] Starting request: urn:request:510309d5-8556-4ec6-b8db-3567f9b07ad9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:00,653 [282] [DEBUG] [app] Starting request: urn:request:4ac67caf-a5de-480a-9962-fab9f245ba2b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [292] [DEBUG] [app] Starting request: urn:request:f7cf2c2e-6efa-4b90-9a9a-cac62baa0c4b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [284] [DEBUG] [app] Starting request: urn:request:7b47114c-c62a-472e-9a6b-995a68b8dd56 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [292] [DEBUG] [app] Ending request: urn:request:f7cf2c2e-6efa-4b90-9a9a-cac62baa0c4b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f7cf2c2e-6efa-4b90-9a9a-cac62baa0c4b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [284] [DEBUG] [app] Ending request: urn:request:7b47114c-c62a-472e-9a6b-995a68b8dd56 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7b47114c-c62a-472e-9a6b-995a68b8dd56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:57:00,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:00,659 [278] [DEBUG] [app] Starting request: urn:request:a4d5453f-59e2-495f-b686-c6d1018aeb08 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:00,659 [279] [DEBUG] [app] Starting request: urn:request:dceae59a-f428-4ed3-8438-9100c2338e74 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:00,659 [278] [DEBUG] [app] Ending request: urn:request:a4d5453f-59e2-495f-b686-c6d1018aeb08 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a4d5453f-59e2-495f-b686-c6d1018aeb08', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:00,659 [279] [DEBUG] [app] Ending request: urn:request:dceae59a-f428-4ed3-8438-9100c2338e74 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dceae59a-f428-4ed3-8438-9100c2338e74', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:57:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:00,674 [282] [DEBUG] [app] Ending request: urn:request:4ac67caf-a5de-480a-9962-fab9f245ba2b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4ac67caf-a5de-480a-9962-fab9f245ba2b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:00,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:57:00,674 [278] [DEBUG] [app] Ending request: urn:request:510309d5-8556-4ec6-b8db-3567f9b07ad9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:510309d5-8556-4ec6-b8db-3567f9b07ad9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:57:00,787 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:57:02,301 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:16.552337+00:00 (in 13.995515 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:02 UTC)" (scheduled at 2024-04-22 03:57:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:57:03,536 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:57:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:13.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 03:57:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:13 UTC)" (scheduled at 2024-04-22 03:57:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 3, 760425), True, datetime.datetime(2024, 4, 22, 3, 57, 3, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:03,886 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:57:03,987 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:57:04,549 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:57:04,554 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:57:04,557 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:57:05,119 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:57:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:26.873109+00:00 (in 21.000741 seconds)
securityworker stdout | 2024-04-22 03:57:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:35 UTC)" (scheduled at 2024-04-22 03:57:05.871852+00:00)
securityworker stdout | 2024-04-22 03:57:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:57:06,276 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:57:06,435 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:57:06,511 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:57:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:57:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:13.555667+00:00 (in 7.002680 seconds)
repositorygcworker stdout | 2024-04-22 03:57:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:06 UTC)" (scheduled at 2024-04-22 03:57:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:57:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:57:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 6, 553279), True, datetime.datetime(2024, 4, 22, 3, 57, 6, 553279), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:57:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:57:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:57:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:57:07,475 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:57:08,841 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:57:08,893 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:57:09,227 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:57:09,313 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:57:10,563 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:57:10,817 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:57:10,820 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:57:10,822 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:57:10,825 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:57:10,827 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:57:10,831 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:57:10,834 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:57:10,837 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:57:10,840 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:57:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:57:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:41.264267+00:00 (in 29.999451 seconds)
autopruneworker stdout | 2024-04-22 03:57:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:41 UTC)" (scheduled at 2024-04-22 03:57:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:57:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758171271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:57:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:57:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:57:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:57:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:06.552482+00:00 (in 52.996320 seconds)
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:13 UTC)" (scheduled at 2024-04-22 03:57:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:57:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:19.762424+00:00 (in 6.002513 seconds)
notificationworker stdout | 2024-04-22 03:57:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:23 UTC)" (scheduled at 2024-04-22 03:57:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 13, 760212), True, datetime.datetime(2024, 4, 22, 3, 57, 13, 760212), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:57:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:44.952062+00:00 (in 29.999534 seconds)
gcworker stdout | 2024-04-22 03:57:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:44 UTC)" (scheduled at 2024-04-22 03:57:14.952062+00:00)
gcworker stdout | 2024-04-22 03:57:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548634952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:57:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:57:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:57:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:57:15,653 [282] [DEBUG] [app] Starting request: urn:request:6c08815d-af71-40aa-9d95-5c8cf8ee592d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:15,653 [278] [DEBUG] [app] Starting request: urn:request:e2929a3c-ec2d-4965-be27-e4864a0456fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:15,656 [292] [DEBUG] [app] Starting request: urn:request:b0af0481-9963-4b22-a3ad-2d2766843c07 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:15,656 [288] [DEBUG] [app] Starting request: urn:request:b955b669-cbd0-43e7-87e6-c5d762ee637b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [292] [DEBUG] [app] Ending request: urn:request:b0af0481-9963-4b22-a3ad-2d2766843c07 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b0af0481-9963-4b22-a3ad-2d2766843c07', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [288] [DEBUG] [app] Ending request: urn:request:b955b669-cbd0-43e7-87e6-c5d762ee637b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b955b669-cbd0-43e7-87e6-c5d762ee637b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:15,660 [282] [DEBUG] [app] Starting request: urn:request:5898e807-4d96-449f-b5f1-28a668679907 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:15,660 [282] [DEBUG] [app] Ending request: urn:request:5898e807-4d96-449f-b5f1-28a668679907 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5898e807-4d96-449f-b5f1-28a668679907', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:15,660 [281] [DEBUG] [app] Starting request: urn:request:82976e03-8e77-4e43-be32-4c515130fd44 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:15,660 [281] [DEBUG] [app] Ending request: urn:request:82976e03-8e77-4e43-be32-4c515130fd44 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:82976e03-8e77-4e43-be32-4c515130fd44', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:15,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:15,675 [278] [DEBUG] [app] Ending request: urn:request:e2929a3c-ec2d-4965-be27-e4864a0456fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e2929a3c-ec2d-4965-be27-e4864a0456fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:57:15,678 [282] [DEBUG] [app] Ending request: urn:request:6c08815d-af71-40aa-9d95-5c8cf8ee592d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6c08815d-af71-40aa-9d95-5c8cf8ee592d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:15,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:15,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:21.555879+00:00 (in 5.002831 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:16 UTC)" (scheduled at 2024-04-22 03:57:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 16, 553528), True, datetime.datetime(2024, 4, 22, 3, 57, 16, 553528), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:16 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,763 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,763 [66] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2024-04-22 03:57:16 UTC)" (scheduled at 2024-04-22 03:57:16.762836+00:00)
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,763 [66] [DEBUG] [__main__] Garbage collecting expired app specific tokens with window: 1 day, 0:00:00
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,764 [66] [DEBUG] [peewee] ('DELETE FROM "appspecificauthtoken" WHERE ("appspecificauthtoken"."expiration" < %s)', [datetime.datetime(2024, 4, 21, 3, 57, 16, 764312)])
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,765 [66] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:57:16.762836+00:00 (in 3599.997808 seconds)
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,774 [66] [DEBUG] [data.database] Disconnecting from database.
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,774 [66] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2024-04-22 04:57:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:57:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:57:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:47.052354+00:00 (in 29.999454 seconds)
buildlogsarchiver stdout | 2024-04-22 03:57:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:47 UTC)" (scheduled at 2024-04-22 03:57:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:57:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 57, 17, 53153), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:57:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:57:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:57:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:57:19,632 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:57:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:23.759375+00:00 (in 3.996386 seconds)
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:19 UTC)" (scheduled at 2024-04-22 03:57:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,136 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:02.556208+00:00 (in 40.999556 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:21 UTC)" (scheduled at 2024-04-22 03:57:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,568 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), True, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), True, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:38.058708+00:00 (in 15.999195 seconds)
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:22 UTC)" (scheduled at 2024-04-22 03:57:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:57:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:33.759375+00:00 (in 9.999488 seconds)
notificationworker stdout | 2024-04-22 03:57:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:33 UTC)" (scheduled at 2024-04-22 03:57:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 23, 760318), True, datetime.datetime(2024, 4, 22, 3, 57, 23, 760318), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:24.361582+00:00 (in 59.999447 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:24 UTC)" (scheduled at 2024-04-22 03:57:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:57:24,784 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:57:26,408 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:57:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:35.871852+00:00 (in 8.998229 seconds)
securityworker stdout | 2024-04-22 03:57:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:56 UTC)" (scheduled at 2024-04-22 03:57:26.873109+00:00)
securityworker stdout | 2024-04-22 03:57:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:57:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:57:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:26,883 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:57:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 52, 26, 882864), 1, 2])
securityworker stdout | 2024-04-22 03:57:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 52, 26, 882864), 1, 2])
securityworker stdout | 2024-04-22 03:57:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:26,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:26,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:57:27,863 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:57:29,747 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:57:29,903 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:57:29,939 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:57:29,945 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:57:29,949 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:57:29,951 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:57:29,954 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:57:30,653 [278] [DEBUG] [app] Starting request: urn:request:12dbfe31-f294-4738-b4f6-78988a390115 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:30,653 [282] [DEBUG] [app] Starting request: urn:request:b54005f5-cfab-4812-a399-c5b2cd9c95d1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [284] [DEBUG] [app] Starting request: urn:request:66beaad8-e23b-46b0-94cf-ec8f25dd45d4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [290] [DEBUG] [app] Starting request: urn:request:05608005-60b7-4570-a978-93038d19ed3a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [284] [DEBUG] [app] Ending request: urn:request:66beaad8-e23b-46b0-94cf-ec8f25dd45d4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:66beaad8-e23b-46b0-94cf-ec8f25dd45d4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [290] [DEBUG] [app] Ending request: urn:request:05608005-60b7-4570-a978-93038d19ed3a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05608005-60b7-4570-a978-93038d19ed3a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:57:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:57:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:30,659 [278] [DEBUG] [app] Starting request: urn:request:880b5d88-dcec-4fc8-b480-3200c08f2231 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:30,659 [281] [DEBUG] [app] Starting request: urn:request:232039f8-a6b1-457d-82ab-4873ba61d3b8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:30,660 [278] [DEBUG] [app] Ending request: urn:request:880b5d88-dcec-4fc8-b480-3200c08f2231 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:880b5d88-dcec-4fc8-b480-3200c08f2231', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:30,660 [281] [DEBUG] [app] Ending request: urn:request:232039f8-a6b1-457d-82ab-4873ba61d3b8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:232039f8-a6b1-457d-82ab-4873ba61d3b8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:30,675 [278] [DEBUG] [app] Ending request: urn:request:12dbfe31-f294-4738-b4f6-78988a390115 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:12dbfe31-f294-4738-b4f6-78988a390115', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:57:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:57:30,676 [282] [DEBUG] [app] Ending request: urn:request:b54005f5-cfab-4812-a399-c5b2cd9c95d1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b54005f5-cfab-4812-a399-c5b2cd9c95d1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:30,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 03:57:30,823 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:57:32,337 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:57:33,572 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:57:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:43.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 03:57:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:43 UTC)" (scheduled at 2024-04-22 03:57:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 33, 760250), True, datetime.datetime(2024, 4, 22, 3, 57, 33, 760250), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:33,921 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:57:34,022 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:57:34,557 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:57:34,561 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:57:34,564 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:57:35,155 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:56.873109+00:00 (in 21.000718 seconds)
securityworker stdout | 2024-04-22 03:57:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:05 UTC)" (scheduled at 2024-04-22 03:57:35.871852+00:00)
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:35,889 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:35,891 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:35,891 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:57:36,306 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:57:36,470 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:57:36,522 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:57:37,500 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 03:57:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:57:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:43.057186+00:00 (in 4.998026 seconds)
namespacegcworker stdout | 2024-04-22 03:57:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:38 UTC)" (scheduled at 2024-04-22 03:57:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:57:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:57:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), True, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:57:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), True, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:57:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:57:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:57:38,877 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:57:38,905 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:57:39,258 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:57:39,349 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:41.564959+00:00 (in 1.997506 seconds)
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:39 UTC)" (scheduled at 2024-04-22 03:57:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:57:40,587 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:57:40,826 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:57:40,832 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:57:40,835 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:57:40,837 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:57:40,840 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:57:40,843 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:57:40,846 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:57:40,849 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:57:40,852 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:57:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:57:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:11.264267+00:00 (in 29.999506 seconds)
autopruneworker stdout | 2024-04-22 03:57:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:11 UTC)" (scheduled at 2024-04-22 03:57:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:57:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758201271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:57:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:57:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:57:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:39.566970+00:00 (in 58.001539 seconds)
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:41 UTC)" (scheduled at 2024-04-22 03:57:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:57:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 41, 565659), True, datetime.datetime(2024, 4, 22, 3, 57, 41, 565659), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:57:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:57:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:57:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:22.058978+00:00 (in 39.001330 seconds)
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:43 UTC)" (scheduled at 2024-04-22 03:57:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:57:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 43, 57935), True, datetime.datetime(2024, 4, 22, 3, 57, 43, 57935), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:57:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:57:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:57:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:57:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:53.759375+00:00 (in 9.999501 seconds)
notificationworker stdout | 2024-04-22 03:57:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:53 UTC)" (scheduled at 2024-04-22 03:57:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 43, 760259), True, datetime.datetime(2024, 4, 22, 3, 57, 43, 760259), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:57:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:14.952062+00:00 (in 29.999535 seconds)
gcworker stdout | 2024-04-22 03:57:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:14 UTC)" (scheduled at 2024-04-22 03:57:44.952062+00:00)
gcworker stdout | 2024-04-22 03:57:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548664953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:57:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:57:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:57:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:57:45,652 [281] [DEBUG] [app] Starting request: urn:request:9c4b6108-61f7-45a8-b7a6-a49ade72d2fa (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:45,652 [278] [DEBUG] [app] Starting request: urn:request:993fa23e-ed68-412b-a8dd-37c37564acd2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [291] [DEBUG] [app] Starting request: urn:request:6f2c2e8d-e317-4530-a343-f23727c64dc9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [292] [DEBUG] [app] Starting request: urn:request:cf31a0b7-6349-469e-a3a2-8feda6566d1a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [291] [DEBUG] [app] Ending request: urn:request:6f2c2e8d-e317-4530-a343-f23727c64dc9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6f2c2e8d-e317-4530-a343-f23727c64dc9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [292] [DEBUG] [app] Ending request: urn:request:cf31a0b7-6349-469e-a3a2-8feda6566d1a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf31a0b7-6349-469e-a3a2-8feda6566d1a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:57:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 03:57:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:45,659 [278] [DEBUG] [app] Starting request: urn:request:7dae39e3-f78a-4227-91ba-5c0631bd8c26 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:45,659 [282] [DEBUG] [app] Starting request: urn:request:7fea865c-fc81-483f-84b6-27ec419a7bc2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:45,659 [278] [DEBUG] [app] Ending request: urn:request:7dae39e3-f78a-4227-91ba-5c0631bd8c26 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7dae39e3-f78a-4227-91ba-5c0631bd8c26', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:45,660 [282] [DEBUG] [app] Ending request: urn:request:7fea865c-fc81-483f-84b6-27ec419a7bc2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7fea865c-fc81-483f-84b6-27ec419a7bc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:45,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:45,674 [281] [DEBUG] [app] Ending request: urn:request:9c4b6108-61f7-45a8-b7a6-a49ade72d2fa (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9c4b6108-61f7-45a8-b7a6-a49ade72d2fa', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:57:45,675 [278] [DEBUG] [app] Ending request: urn:request:993fa23e-ed68-412b-a8dd-37c37564acd2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:993fa23e-ed68-412b-a8dd-37c37564acd2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:57:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:57:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:17.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 03:57:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:17 UTC)" (scheduled at 2024-04-22 03:57:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:57:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 57, 47, 53157), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:57:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:57:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:57:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:57:49,668 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:57:51,172 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:57:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:03.759375+00:00 (in 9.999458 seconds)
notificationworker stdout | 2024-04-22 03:57:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:03 UTC)" (scheduled at 2024-04-22 03:57:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 53, 760302), True, datetime.datetime(2024, 4, 22, 3, 57, 53, 760302), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:57:54,801 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:57:56,445 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:57:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 03:57:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:26 UTC)" (scheduled at 2024-04-22 03:57:56.873109+00:00)
securityworker stdout | 2024-04-22 03:57:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:57:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:57:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 52, 56, 881042), 1, 2])
securityworker stdout | 2024-04-22 03:57:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 52, 56, 881042), 1, 2])
securityworker stdout | 2024-04-22 03:57:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:57:57,880 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:57:59,753 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:57:59,939 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:57:59,946 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:57:59,952 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:57:59,958 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:57:59,960 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:57:59,963 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:58:00,653 [282] [DEBUG] [app] Starting request: urn:request:190ad1fb-3464-4790-b506-8f4b35366f53 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:00,653 [279] [DEBUG] [app] Starting request: urn:request:921b64db-ff75-4d9c-8a73-51bb05583c38 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [290] [DEBUG] [app] Starting request: urn:request:30ff6248-4e16-4471-801b-5f57b4f44a20 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [284] [DEBUG] [app] Starting request: urn:request:c4e70879-6a0b-4e07-b639-e3e116e8161e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [284] [DEBUG] [app] Ending request: urn:request:c4e70879-6a0b-4e07-b639-e3e116e8161e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c4e70879-6a0b-4e07-b639-e3e116e8161e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [290] [DEBUG] [app] Ending request: urn:request:30ff6248-4e16-4471-801b-5f57b4f44a20 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:30ff6248-4e16-4471-801b-5f57b4f44a20', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:58:00,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:58:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:00,659 [279] [DEBUG] [app] Starting request: urn:request:5a67a244-c286-48a7-8e15-3c53e4d49d82 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:00,659 [279] [DEBUG] [app] Ending request: urn:request:5a67a244-c286-48a7-8e15-3c53e4d49d82 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5a67a244-c286-48a7-8e15-3c53e4d49d82', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:00,660 [278] [DEBUG] [app] Starting request: urn:request:577c481d-0e62-46e8-9330-7f59207669b5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:00,660 [278] [DEBUG] [app] Ending request: urn:request:577c481d-0e62-46e8-9330-7f59207669b5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:577c481d-0e62-46e8-9330-7f59207669b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:00,674 [279] [DEBUG] [app] Ending request: urn:request:921b64db-ff75-4d9c-8a73-51bb05583c38 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:921b64db-ff75-4d9c-8a73-51bb05583c38', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:00,675 [282] [DEBUG] [app] Ending request: urn:request:190ad1fb-3464-4790-b506-8f4b35366f53 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:190ad1fb-3464-4790-b506-8f4b35366f53', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:58:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:58:00,838 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:58:02,371 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:16.552337+00:00 (in 13.995623 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:02 UTC)" (scheduled at 2024-04-22 03:58:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:58:03,581 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:58:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:13.759375+00:00 (in 9.999496 seconds)
notificationworker stdout | 2024-04-22 03:58:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:13 UTC)" (scheduled at 2024-04-22 03:58:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 3, 760278), True, datetime.datetime(2024, 4, 22, 3, 58, 3, 760278), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:03,939 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:58:04,059 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:58:04,565 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:58:04,570 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:58:04,572 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:58:05,176 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:58:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:26.873109+00:00 (in 21.000711 seconds)
securityworker stdout | 2024-04-22 03:58:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:35 UTC)" (scheduled at 2024-04-22 03:58:05.871852+00:00)
securityworker stdout | 2024-04-22 03:58:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:58:06,339 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:58:06,506 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:58:06,548 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:58:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:58:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:13.555667+00:00 (in 7.002743 seconds)
repositorygcworker stdout | 2024-04-22 03:58:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:06 UTC)" (scheduled at 2024-04-22 03:58:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:58:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:58:06,553 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 6, 553175), True, datetime.datetime(2024, 4, 22, 3, 58, 6, 553175), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:58:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:58:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:58:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:58:07,532 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:58:08,914 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:58:08,931 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:58:09,287 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:58:09,385 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:58:10,622 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:58:10,835 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:58:10,841 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:58:10,844 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:58:10,847 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:58:10,850 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:58:10,853 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:58:10,857 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:58:10,860 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:58:10,863 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:58:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:58:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:41.264267+00:00 (in 29.999550 seconds)
autopruneworker stdout | 2024-04-22 03:58:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:41 UTC)" (scheduled at 2024-04-22 03:58:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:58:11,281 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758231280, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:58:11,285 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:58:11,285 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:58:11,285 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:58:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:06.552482+00:00 (in 52.996399 seconds)
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:13 UTC)" (scheduled at 2024-04-22 03:58:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:19.762160+00:00 (in 6.002319 seconds)
notificationworker stdout | 2024-04-22 03:58:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:23 UTC)" (scheduled at 2024-04-22 03:58:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 13, 760145), True, datetime.datetime(2024, 4, 22, 3, 58, 13, 760145), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:58:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:44.952062+00:00 (in 29.999511 seconds)
gcworker stdout | 2024-04-22 03:58:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:44 UTC)" (scheduled at 2024-04-22 03:58:14.952062+00:00)
gcworker stdout | 2024-04-22 03:58:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548694952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:58:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:58:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:58:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:58:15,653 [282] [DEBUG] [app] Starting request: urn:request:052aee22-1810-4194-bd70-08cff0fa32b1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:15,653 [278] [DEBUG] [app] Starting request: urn:request:0e21fc33-5957-450f-83cc-caff3a339c10 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [291] [DEBUG] [app] Starting request: urn:request:84bfb36f-f31a-47f4-b2f9-a1b24bf69f27 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [284] [DEBUG] [app] Starting request: urn:request:1ce577eb-0a9a-4069-ab1b-f52d8324f0c6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [291] [DEBUG] [app] Ending request: urn:request:84bfb36f-f31a-47f4-b2f9-a1b24bf69f27 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:84bfb36f-f31a-47f4-b2f9-a1b24bf69f27', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [284] [DEBUG] [app] Ending request: urn:request:1ce577eb-0a9a-4069-ab1b-f52d8324f0c6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1ce577eb-0a9a-4069-ab1b-f52d8324f0c6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:58:15,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:58:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:15,659 [282] [DEBUG] [app] Starting request: urn:request:43f2f116-cf53-49cf-8c35-252210048bf3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:15,659 [281] [DEBUG] [app] Starting request: urn:request:9a860cc1-6951-4bd8-8193-e3c653c88046 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:15,660 [282] [DEBUG] [app] Ending request: urn:request:43f2f116-cf53-49cf-8c35-252210048bf3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:43f2f116-cf53-49cf-8c35-252210048bf3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:15,660 [281] [DEBUG] [app] Ending request: urn:request:9a860cc1-6951-4bd8-8193-e3c653c88046 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a860cc1-6951-4bd8-8193-e3c653c88046', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:15,674 [282] [DEBUG] [app] Ending request: urn:request:052aee22-1810-4194-bd70-08cff0fa32b1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:052aee22-1810-4194-bd70-08cff0fa32b1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:15,675 [278] [DEBUG] [app] Ending request: urn:request:0e21fc33-5957-450f-83cc-caff3a339c10 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0e21fc33-5957-450f-83cc-caff3a339c10', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:58:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:58:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:02.556208+00:00 (in 46.003332 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:16 UTC)" (scheduled at 2024-04-22 03:58:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 16, 553303), True, datetime.datetime(2024, 4, 22, 3, 58, 16, 553303), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:58:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:58:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:47.052354+00:00 (in 29.999473 seconds)
buildlogsarchiver stdout | 2024-04-22 03:58:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:47 UTC)" (scheduled at 2024-04-22 03:58:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:58:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 58, 17, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:58:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:58:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:58:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:58:19,705 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:58:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:23.759375+00:00 (in 3.996689 seconds)
notificationworker stdout | 2024-04-22 03:58:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:03:19 UTC)" (scheduled at 2024-04-22 03:58:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:58:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 'notification/%'])
notificationworker stdout | 2024-04-22 03:58:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:19 UTC)" (scheduled at 2024-04-22 03:58:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:58:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:58:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), True, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:58:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), True, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 'notification/%'])
notificationworker stdout | 2024-04-22 03:58:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:03:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:58:21,182 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:43.057186+00:00 (in 20.997700 seconds)
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:22 UTC)" (scheduled at 2024-04-22 03:58:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:33.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 03:58:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:33 UTC)" (scheduled at 2024-04-22 03:58:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 23, 760301), True, datetime.datetime(2024, 4, 22, 3, 58, 23, 760301), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:24.361582+00:00 (in 59.999449 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:24 UTC)" (scheduled at 2024-04-22 03:58:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:58:24,815 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:58:26,481 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:58:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:35.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 03:58:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:56 UTC)" (scheduled at 2024-04-22 03:58:26.873109+00:00)
securityworker stdout | 2024-04-22 03:58:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:58:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:58:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 53, 26, 881358), 1, 2])
securityworker stdout | 2024-04-22 03:58:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 53, 26, 881358), 1, 2])
securityworker stdout | 2024-04-22 03:58:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:58:27,904 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:58:29,787 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:58:29,954 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
chunkcleanupworker stdout | 2024-04-22 03:58:29,959 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:58:29,962 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:58:29,965 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:58:29,968 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:58:29,970 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:58:30,653 [278] [DEBUG] [app] Starting request: urn:request:2b34a362-8c09-41a4-88c1-b6afc227726f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:30,653 [279] [DEBUG] [app] Starting request: urn:request:1e33e048-86a4-4841-a958-fba6728cc499 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:30,656 [284] [DEBUG] [app] Starting request: urn:request:1712af3d-1b16-4c04-8978-c2e572dda233 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:30,656 [288] [DEBUG] [app] Starting request: urn:request:3f551f63-bfb3-429f-b33c-b52423a7b0fc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [284] [DEBUG] [app] Ending request: urn:request:1712af3d-1b16-4c04-8978-c2e572dda233 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1712af3d-1b16-4c04-8978-c2e572dda233', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [288] [DEBUG] [app] Ending request: urn:request:3f551f63-bfb3-429f-b33c-b52423a7b0fc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3f551f63-bfb3-429f-b33c-b52423a7b0fc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:58:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:30,660 [282] [DEBUG] [app] Starting request: urn:request:3eda171d-e576-4f27-91b9-89ccd9032a49 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [281] [DEBUG] [app] Starting request: urn:request:e61f3b0f-22f5-42b7-be22-1da666e726a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [282] [DEBUG] [app] Ending request: urn:request:3eda171d-e576-4f27-91b9-89ccd9032a49 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3eda171d-e576-4f27-91b9-89ccd9032a49', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [281] [DEBUG] [app] Ending request: urn:request:e61f3b0f-22f5-42b7-be22-1da666e726a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e61f3b0f-22f5-42b7-be22-1da666e726a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:30,675 [279] [DEBUG] [app] Ending request: urn:request:1e33e048-86a4-4841-a958-fba6728cc499 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1e33e048-86a4-4841-a958-fba6728cc499', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:58:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:58:30,675 [278] [DEBUG] [app] Ending request: urn:request:2b34a362-8c09-41a4-88c1-b6afc227726f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2b34a362-8c09-41a4-88c1-b6afc227726f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:58:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 03:58:30,845 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:58:32,405 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:58:33,613 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:58:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:43.759375+00:00 (in 9.999438 seconds)
notificationworker stdout | 2024-04-22 03:58:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:43 UTC)" (scheduled at 2024-04-22 03:58:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 33, 760340), True, datetime.datetime(2024, 4, 22, 3, 58, 33, 760340), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:33,969 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:58:34,095 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:58:34,572 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:58:34,578 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:58:34,580 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:58:35,213 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:58:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:56.873109+00:00 (in 21.000724 seconds)
securityworker stdout | 2024-04-22 03:58:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:05 UTC)" (scheduled at 2024-04-22 03:58:35.871852+00:00)
securityworker stdout | 2024-04-22 03:58:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:58:36,375 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:58:36,515 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:58:36,585 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:58:37,540 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:58:38,950 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:58:38,966 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:58:39,323 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:58:39,422 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:41.564959+00:00 (in 1.997543 seconds)
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:39 UTC)" (scheduled at 2024-04-22 03:58:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:58:40,659 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:58:40,842 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:58:40,850 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:58:40,852 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:58:40,855 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:58:40,859 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:58:40,862 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:58:40,867 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:58:40,871 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:58:40,873 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:58:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:58:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:11.264267+00:00 (in 29.999418 seconds)
autopruneworker stdout | 2024-04-22 03:58:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:11 UTC)" (scheduled at 2024-04-22 03:58:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:58:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758261271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:58:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:58:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:58:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:39.566970+00:00 (in 58.001494 seconds)
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:41 UTC)" (scheduled at 2024-04-22 03:58:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:58:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 41, 565739), True, datetime.datetime(2024, 4, 22, 3, 58, 41, 565739), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:58:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:58:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:58:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:58:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:58:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:22.058978+00:00 (in 39.001283 seconds)
namespacegcworker stdout | 2024-04-22 03:58:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:43 UTC)" (scheduled at 2024-04-22 03:58:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:58:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:58:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 43, 58041), True, datetime.datetime(2024, 4, 22, 3, 58, 43, 58041), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:58:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:58:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:58:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:53.759375+00:00 (in 9.999466 seconds)
notificationworker stdout | 2024-04-22 03:58:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:53 UTC)" (scheduled at 2024-04-22 03:58:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 43, 760213), True, datetime.datetime(2024, 4, 22, 3, 58, 43, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:58:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:14.952062+00:00 (in 29.999544 seconds)
gcworker stdout | 2024-04-22 03:58:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:14 UTC)" (scheduled at 2024-04-22 03:58:44.952062+00:00)
gcworker stdout | 2024-04-22 03:58:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548724952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:58:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:58:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:58:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:58:45,652 [278] [DEBUG] [app] Starting request: urn:request:f17f8839-4a15-40b4-8bb2-bc7109d77b55 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:45,652 [279] [DEBUG] [app] Starting request: urn:request:b702bea7-cc3c-473b-893e-008f74474f91 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [284] [DEBUG] [app] Starting request: urn:request:13c0092c-e944-4e88-b710-c592520d7111 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [284] [DEBUG] [app] Ending request: urn:request:13c0092c-e944-4e88-b710-c592520d7111 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:13c0092c-e944-4e88-b710-c592520d7111', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [289] [DEBUG] [app] Starting request: urn:request:49fe4300-2727-4a75-ad98-3a5b9cdc66bb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [289] [DEBUG] [app] Ending request: urn:request:49fe4300-2727-4a75-ad98-3a5b9cdc66bb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:49fe4300-2727-4a75-ad98-3a5b9cdc66bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:58:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:58:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:45,659 [281] [DEBUG] [app] Starting request: urn:request:442b8dd1-54a2-48fa-b677-844d27c77da4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:45,659 [278] [DEBUG] [app] Starting request: urn:request:b30133f5-5122-417d-8e85-d5b2a3588758 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:45,659 [278] [DEBUG] [app] Ending request: urn:request:b30133f5-5122-417d-8e85-d5b2a3588758 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b30133f5-5122-417d-8e85-d5b2a3588758', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:45,659 [281] [DEBUG] [app] Ending request: urn:request:442b8dd1-54a2-48fa-b677-844d27c77da4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:442b8dd1-54a2-48fa-b677-844d27c77da4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:45,674 [279] [DEBUG] [app] Ending request: urn:request:b702bea7-cc3c-473b-893e-008f74474f91 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b702bea7-cc3c-473b-893e-008f74474f91', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:58:45,674 [278] [DEBUG] [app] Ending request: urn:request:f17f8839-4a15-40b4-8bb2-bc7109d77b55 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f17f8839-4a15-40b4-8bb2-bc7109d77b55', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:58:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
buildlogsarchiver stdout | 2024-04-22 03:58:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:58:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:17.052354+00:00 (in 29.999454 seconds)
buildlogsarchiver stdout | 2024-04-22 03:58:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:17 UTC)" (scheduled at 2024-04-22 03:58:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:58:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 58, 47, 53269), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:58:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:58:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:58:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:58:49,741 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:58:51,219 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:58:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:03.759375+00:00 (in 9.999507 seconds)
notificationworker stdout | 2024-04-22 03:58:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:03 UTC)" (scheduled at 2024-04-22 03:58:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 53, 760302), True, datetime.datetime(2024, 4, 22, 3, 58, 53, 760302), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:58:54,833 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:58:56,510 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:58:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:05.871852+00:00 (in 8.998227 seconds)
securityworker stdout | 2024-04-22 03:58:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:26 UTC)" (scheduled at 2024-04-22 03:58:56.873109+00:00)
securityworker stdout | 2024-04-22 03:58:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:58:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:58:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 53, 56, 881197), 1, 2])
securityworker stdout | 2024-04-22 03:58:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 53, 56, 881197), 1, 2])
securityworker stdout | 2024-04-22 03:58:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:58:57,939 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:58:59,823 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:58:59,962 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:58:59,970 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:58:59,973 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:58:59,976 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:58:59,978 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 03:58:59,994 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:59:00,653 [282] [DEBUG] [app] Starting request: urn:request:2ebb5330-94ae-4b0b-ae15-363a1e3382fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:00,653 [278] [DEBUG] [app] Starting request: urn:request:c546212c-f11d-4f90-85b2-6c910eff7dee (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [284] [DEBUG] [app] Starting request: urn:request:ee9e8cb3-73c2-486b-9568-82a1d92c5554 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [291] [DEBUG] [app] Starting request: urn:request:a3bfe685-2cd3-4f1a-9a38-6e3f7152fd14 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [284] [DEBUG] [app] Ending request: urn:request:ee9e8cb3-73c2-486b-9568-82a1d92c5554 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ee9e8cb3-73c2-486b-9568-82a1d92c5554', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [291] [DEBUG] [app] Ending request: urn:request:a3bfe685-2cd3-4f1a-9a38-6e3f7152fd14 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a3bfe685-2cd3-4f1a-9a38-6e3f7152fd14', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:59:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:00,659 [278] [DEBUG] [app] Starting request: urn:request:b6473c89-4229-410a-83a4-e2ba33bf558b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:00,659 [278] [DEBUG] [app] Ending request: urn:request:b6473c89-4229-410a-83a4-e2ba33bf558b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b6473c89-4229-410a-83a4-e2ba33bf558b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:00,659 [281] [DEBUG] [app] Starting request: urn:request:fa46c21b-d204-4155-b6ed-300e5227900f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:00,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:00,660 [281] [DEBUG] [app] Ending request: urn:request:fa46c21b-d204-4155-b6ed-300e5227900f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fa46c21b-d204-4155-b6ed-300e5227900f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:00,674 [278] [DEBUG] [app] Ending request: urn:request:c546212c-f11d-4f90-85b2-6c910eff7dee (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c546212c-f11d-4f90-85b2-6c910eff7dee', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:00,674 [282] [DEBUG] [app] Ending request: urn:request:2ebb5330-94ae-4b0b-ae15-363a1e3382fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ebb5330-94ae-4b0b-ae15-363a1e3382fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:59:00,873 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:59:02,437 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:16.552337+00:00 (in 13.995622 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:02 UTC)" (scheduled at 2024-04-22 03:59:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:59:03,635 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:59:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:13.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 03:59:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:13 UTC)" (scheduled at 2024-04-22 03:59:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 3, 760164), True, datetime.datetime(2024, 4, 22, 3, 59, 3, 760164), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:03,985 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:59:04,117 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:59:04,580 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:59:04,586 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:59:04,588 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:59:05,249 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:59:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:26.873109+00:00 (in 21.000661 seconds)
securityworker stdout | 2024-04-22 03:59:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:35 UTC)" (scheduled at 2024-04-22 03:59:05.871852+00:00)
securityworker stdout | 2024-04-22 03:59:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:59:06,389 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:59:06,550 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
repositorygcworker stdout | 2024-04-22 03:59:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:59:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:13.555667+00:00 (in 7.002757 seconds)
repositorygcworker stdout | 2024-04-22 03:59:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:06 UTC)" (scheduled at 2024-04-22 03:59:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:59:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:59:06,553 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 6, 553136), True, datetime.datetime(2024, 4, 22, 3, 59, 6, 553136), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:59:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:59:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:59:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:06 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:59:06,615 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:59:07,557 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:59:08,987 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:59:08,998 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:59:09,331 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:59:09,449 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:59:10,697 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:59:10,852 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:59:10,856 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:59:10,863 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:59:10,866 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:59:10,869 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:59:10,872 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:59:10,877 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:59:10,882 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:59:10,884 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:59:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:59:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:41.264267+00:00 (in 29.999379 seconds)
autopruneworker stdout | 2024-04-22 03:59:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:41 UTC)" (scheduled at 2024-04-22 03:59:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:59:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758291272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:59:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:59:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:59:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:59:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:06.552482+00:00 (in 52.996319 seconds)
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:13 UTC)" (scheduled at 2024-04-22 03:59:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:19.762424+00:00 (in 6.002607 seconds)
notificationworker stdout | 2024-04-22 03:59:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:23 UTC)" (scheduled at 2024-04-22 03:59:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 13, 760189), True, datetime.datetime(2024, 4, 22, 3, 59, 13, 760189), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:13,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:59:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:44.952062+00:00 (in 29.999540 seconds)
gcworker stdout | 2024-04-22 03:59:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:44 UTC)" (scheduled at 2024-04-22 03:59:14.952062+00:00)
gcworker stdout | 2024-04-22 03:59:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548754952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:59:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:59:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:59:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:59:15,653 [278] [DEBUG] [app] Starting request: urn:request:95302d72-f981-48cf-a527-e8dad9389bcc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:15,654 [279] [DEBUG] [app] Starting request: urn:request:d401be00-6e9d-46bf-b973-7d018aa478fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:15,657 [286] [DEBUG] [app] Starting request: urn:request:52b16cd8-3c93-4be1-ba25-4d5cb174fdee (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:15,657 [284] [DEBUG] [app] Starting request: urn:request:72561962-b2e6-467e-8746-880268a44aa2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [284] [DEBUG] [app] Ending request: urn:request:72561962-b2e6-467e-8746-880268a44aa2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:72561962-b2e6-467e-8746-880268a44aa2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [286] [DEBUG] [app] Ending request: urn:request:52b16cd8-3c93-4be1-ba25-4d5cb174fdee (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:52b16cd8-3c93-4be1-ba25-4d5cb174fdee', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:59:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:15,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [DEBUG] [app] Starting request: urn:request:ed164cdd-e318-4b0d-92e1-692233d122ac (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [DEBUG] [app] Ending request: urn:request:ed164cdd-e318-4b0d-92e1-692233d122ac (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ed164cdd-e318-4b0d-92e1-692233d122ac', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [281] [DEBUG] [app] Starting request: urn:request:386e7a75-430f-435d-b670-c1a2bcb8fbb2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:15,661 [281] [DEBUG] [app] Ending request: urn:request:386e7a75-430f-435d-b670-c1a2bcb8fbb2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:386e7a75-430f-435d-b670-c1a2bcb8fbb2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:59:15,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:15,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:15,675 [278] [DEBUG] [app] Ending request: urn:request:95302d72-f981-48cf-a527-e8dad9389bcc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:95302d72-f981-48cf-a527-e8dad9389bcc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:15,676 [279] [DEBUG] [app] Ending request: urn:request:d401be00-6e9d-46bf-b973-7d018aa478fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d401be00-6e9d-46bf-b973-7d018aa478fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:15,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:02.556208+00:00 (in 46.003321 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:16 UTC)" (scheduled at 2024-04-22 03:59:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 16, 553321), True, datetime.datetime(2024, 4, 22, 3, 59, 16, 553321), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:59:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:59:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:47.052354+00:00 (in 29.999428 seconds)
buildlogsarchiver stdout | 2024-04-22 03:59:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:47 UTC)" (scheduled at 2024-04-22 03:59:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:59:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 59, 17, 53307), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:59:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:59:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:59:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:23.759375+00:00 (in 3.996401 seconds)
notificationworker stdout | 2024-04-22 03:59:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:19 UTC)" (scheduled at 2024-04-22 03:59:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:59:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:59:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:59:19,777 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:59:21,255 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:43.057186+00:00 (in 20.997629 seconds)
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:22 UTC)" (scheduled at 2024-04-22 03:59:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:33.759375+00:00 (in 9.999467 seconds)
notificationworker stdout | 2024-04-22 03:59:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:33 UTC)" (scheduled at 2024-04-22 03:59:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 23, 760184), True, datetime.datetime(2024, 4, 22, 3, 59, 23, 760184), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:24.361582+00:00 (in 59.999482 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:24 UTC)" (scheduled at 2024-04-22 03:59:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:59:24,869 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:59:26,546 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:59:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:35.871852+00:00 (in 8.998179 seconds)
securityworker stdout | 2024-04-22 03:59:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:56 UTC)" (scheduled at 2024-04-22 03:59:26.873109+00:00)
securityworker stdout | 2024-04-22 03:59:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:59:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:59:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 54, 26, 880908), 1, 2])
securityworker stdout | 2024-04-22 03:59:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 54, 26, 880908), 1, 2])
securityworker stdout | 2024-04-22 03:59:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:59:27,976 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:59:29,860 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:59:29,971 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:59:29,978 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:59:29,981 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:59:29,984 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:59:29,987 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 03:59:30,029 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:59:30,653 [278] [DEBUG] [app] Starting request: urn:request:95cc344d-bb66-4de7-849b-c3028c30b388 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:30,653 [281] [DEBUG] [app] Starting request: urn:request:c3e5ba2e-b29c-4436-86b5-f492aaaf87a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:30,656 [291] [DEBUG] [app] Starting request: urn:request:bc5e9f41-7aae-4b87-be68-972d86d96efc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:30,656 [289] [DEBUG] [app] Starting request: urn:request:acbf08ac-0cf6-4f31-86df-7a2fd95b6e58 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [291] [DEBUG] [app] Ending request: urn:request:bc5e9f41-7aae-4b87-be68-972d86d96efc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bc5e9f41-7aae-4b87-be68-972d86d96efc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [289] [DEBUG] [app] Ending request: urn:request:acbf08ac-0cf6-4f31-86df-7a2fd95b6e58 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:acbf08ac-0cf6-4f31-86df-7a2fd95b6e58', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:59:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [DEBUG] [app] Starting request: urn:request:a10505dd-dc6c-43aa-96c3-c2ebe87c35f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [DEBUG] [app] Ending request: urn:request:a10505dd-dc6c-43aa-96c3-c2ebe87c35f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a10505dd-dc6c-43aa-96c3-c2ebe87c35f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [279] [DEBUG] [app] Starting request: urn:request:6a9a99e7-ba08-4862-9e4e-bc1540b15001 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:30,660 [279] [DEBUG] [app] Ending request: urn:request:6a9a99e7-ba08-4862-9e4e-bc1540b15001 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6a9a99e7-ba08-4862-9e4e-bc1540b15001', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:59:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:30,674 [278] [DEBUG] [app] Ending request: urn:request:95cc344d-bb66-4de7-849b-c3028c30b388 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:95cc344d-bb66-4de7-849b-c3028c30b388', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:30,675 [281] [DEBUG] [app] Ending request: urn:request:c3e5ba2e-b29c-4436-86b5-f492aaaf87a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c3e5ba2e-b29c-4436-86b5-f492aaaf87a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:59:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 03:59:30,905 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:59:32,465 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:59:33,670 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:59:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:43.759375+00:00 (in 9.999489 seconds)
notificationworker stdout | 2024-04-22 03:59:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:43 UTC)" (scheduled at 2024-04-22 03:59:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 33, 760320), True, datetime.datetime(2024, 4, 22, 3, 59, 33, 760320), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:33,993 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:59:34,150 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:59:34,587 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:59:34,593 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:59:34,596 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:59:35,270 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:59:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:56.873109+00:00 (in 21.000628 seconds)
securityworker stdout | 2024-04-22 03:59:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:05 UTC)" (scheduled at 2024-04-22 03:59:35.871852+00:00)
securityworker stdout | 2024-04-22 03:59:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:59:36,426 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:59:36,561 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:59:36,649 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:59:37,593 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:59:39,013 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:59:39,034 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:59:39,368 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:59:39,465 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:41.564959+00:00 (in 1.997471 seconds)
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:39 UTC)" (scheduled at 2024-04-22 03:59:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:59:40,706 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:59:40,864 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:59:40,866 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:59:40,874 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:59:40,879 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:59:40,881 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:59:40,884 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:59:40,886 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:59:40,893 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:59:40,895 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:59:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:59:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:11.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:59:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:11 UTC)" (scheduled at 2024-04-22 03:59:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:59:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758321271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:59:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:59:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:59:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:39.566970+00:00 (in 58.001449 seconds)
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:41 UTC)" (scheduled at 2024-04-22 03:59:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:59:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 41, 565838), True, datetime.datetime(2024, 4, 22, 3, 59, 41, 565838), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:59:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:59:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:59:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:22.058978+00:00 (in 39.001293 seconds)
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:43 UTC)" (scheduled at 2024-04-22 03:59:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:59:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 43, 57973), True, datetime.datetime(2024, 4, 22, 3, 59, 43, 57973), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:59:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:59:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:59:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:53.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 03:59:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:53 UTC)" (scheduled at 2024-04-22 03:59:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 43, 760163), True, datetime.datetime(2024, 4, 22, 3, 59, 43, 760163), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:59:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:14.952062+00:00 (in 29.999512 seconds)
gcworker stdout | 2024-04-22 03:59:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:14 UTC)" (scheduled at 2024-04-22 03:59:44.952062+00:00)
gcworker stdout | 2024-04-22 03:59:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548784952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:59:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:59:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:59:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:59:45,653 [278] [DEBUG] [app] Starting request: urn:request:a7e2ee06-15fd-4cb7-acd6-f077bcf745f1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:45,653 [282] [DEBUG] [app] Starting request: urn:request:3e2059ce-004d-4c78-9a38-d8feba1f2933 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:45,656 [289] [DEBUG] [app] Starting request: urn:request:7c182991-9e26-42ec-bbc6-84f33ad4b6a9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:45,656 [284] [DEBUG] [app] Starting request: urn:request:ed15a92f-cd2b-4879-a153-9dc54814a494 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [284] [DEBUG] [app] Ending request: urn:request:ed15a92f-cd2b-4879-a153-9dc54814a494 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed15a92f-cd2b-4879-a153-9dc54814a494', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [289] [DEBUG] [app] Ending request: urn:request:7c182991-9e26-42ec-bbc6-84f33ad4b6a9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7c182991-9e26-42ec-bbc6-84f33ad4b6a9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:45,660 [278] [DEBUG] [app] Starting request: urn:request:4dc71f4a-7974-41e4-8617-e8b05a02e145 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [281] [DEBUG] [app] Starting request: urn:request:0f7a5bba-55a4-4355-bffa-47c02939e164 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [278] [DEBUG] [app] Ending request: urn:request:4dc71f4a-7974-41e4-8617-e8b05a02e145 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4dc71f4a-7974-41e4-8617-e8b05a02e145', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [281] [DEBUG] [app] Ending request: urn:request:0f7a5bba-55a4-4355-bffa-47c02939e164 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0f7a5bba-55a4-4355-bffa-47c02939e164', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:45,674 [278] [DEBUG] [app] Ending request: urn:request:a7e2ee06-15fd-4cb7-acd6-f077bcf745f1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a7e2ee06-15fd-4cb7-acd6-f077bcf745f1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:45,675 [282] [DEBUG] [app] Ending request: urn:request:3e2059ce-004d-4c78-9a38-d8feba1f2933 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3e2059ce-004d-4c78-9a38-d8feba1f2933', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:45,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:59:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:59:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:17.052354+00:00 (in 29.999476 seconds)
buildlogsarchiver stdout | 2024-04-22 03:59:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:17 UTC)" (scheduled at 2024-04-22 03:59:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:59:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 59, 47, 53245), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:59:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:59:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:59:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:59:49,787 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:59:51,281 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:59:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:03.759375+00:00 (in 9.999453 seconds)
notificationworker stdout | 2024-04-22 03:59:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:03 UTC)" (scheduled at 2024-04-22 03:59:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 53, 760363), True, datetime.datetime(2024, 4, 22, 3, 59, 53, 760363), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:59:54,892 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:59:56,583 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:59:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:05.871852+00:00 (in 8.998130 seconds)
securityworker stdout | 2024-04-22 03:59:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:26 UTC)" (scheduled at 2024-04-22 03:59:56.873109+00:00)
securityworker stdout | 2024-04-22 03:59:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:59:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:59:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:59:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 54, 56, 881568), 1, 2])
securityworker stdout | 2024-04-22 03:59:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 54, 56, 881568), 1, 2])
securityworker stdout | 2024-04-22 03:59:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:59:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:59:58,010 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:59:59,896 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:59:59,979 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:59:59,986 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:59:59,989 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:59:59,991 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:59:59,994 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:00:00,060 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:00:00,653 [278] [DEBUG] [app] Starting request: urn:request:27653218-854d-445a-a63c-20a8ab208276 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:00,653 [282] [DEBUG] [app] Starting request: urn:request:bf29b85e-47c2-4dc4-be00-03963002a926 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [284] [DEBUG] [app] Starting request: urn:request:feacb91d-ea99-4005-b84e-cccbd71b9447 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [291] [DEBUG] [app] Starting request: urn:request:2f4f57ee-2eb7-4586-b735-940af68df292 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [284] [DEBUG] [app] Ending request: urn:request:feacb91d-ea99-4005-b84e-cccbd71b9447 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:feacb91d-ea99-4005-b84e-cccbd71b9447', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [291] [DEBUG] [app] Ending request: urn:request:2f4f57ee-2eb7-4586-b735-940af68df292 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2f4f57ee-2eb7-4586-b735-940af68df292', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:00:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:00,661 [281] [DEBUG] [app] Starting request: urn:request:fe867c34-dfc4-4fa8-a4a0-a636db503f47 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [279] [DEBUG] [app] Starting request: urn:request:1474fa0c-9c1f-4eb3-9394-f7e5c0edef37 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [281] [DEBUG] [app] Ending request: urn:request:fe867c34-dfc4-4fa8-a4a0-a636db503f47 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fe867c34-dfc4-4fa8-a4a0-a636db503f47', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [279] [DEBUG] [app] Ending request: urn:request:1474fa0c-9c1f-4eb3-9394-f7e5c0edef37 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1474fa0c-9c1f-4eb3-9394-f7e5c0edef37', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:00,676 [278] [DEBUG] [app] Ending request: urn:request:27653218-854d-445a-a63c-20a8ab208276 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:27653218-854d-445a-a63c-20a8ab208276', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:00,676 [282] [DEBUG] [app] Ending request: urn:request:bf29b85e-47c2-4dc4-be00-03963002a926 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bf29b85e-47c2-4dc4-be00-03963002a926', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:00,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:00:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotaregistrysizeworker stdout | 2024-04-22 04:00:00,925 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:00:02,481 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:16.552337+00:00 (in 13.995682 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:02 UTC)" (scheduled at 2024-04-22 04:00:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:00:03,682 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 04:00:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:13.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:00:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:13 UTC)" (scheduled at 2024-04-22 04:00:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 3, 760180), True, datetime.datetime(2024, 4, 22, 4, 0, 3, 760180), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:03,778 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:03,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:03,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:04,024 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:00:04,186 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:00:04,594 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:00:04,599 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:00:04,603 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:00:05,306 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:00:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:26.873109+00:00 (in 21.000620 seconds)
securityworker stdout | 2024-04-22 04:00:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:35 UTC)" (scheduled at 2024-04-22 04:00:05.871852+00:00)
securityworker stdout | 2024-04-22 04:00:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:00:06,462 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
repositorygcworker stdout | 2024-04-22 04:00:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:00:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:13.555667+00:00 (in 7.002654 seconds)
repositorygcworker stdout | 2024-04-22 04:00:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:06 UTC)" (scheduled at 2024-04-22 04:00:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:00:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:00:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 6, 553447), True, datetime.datetime(2024, 4, 22, 4, 0, 6, 553447), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:00:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:00:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:00:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:00:06,597 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:00:06,685 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:00:07,629 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:00:09,027 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:00:09,058 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:00:09,404 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:00:09,476 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:00:10,738 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:00:10,875 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:00:10,879 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:00:10,885 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:00:10,888 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:00:10,892 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:00:10,894 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:00:10,898 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:00:10,901 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:00:10,904 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:00:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:00:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:41.264267+00:00 (in 29.999461 seconds)
autopruneworker stdout | 2024-04-22 04:00:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:41 UTC)" (scheduled at 2024-04-22 04:00:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:00:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758351271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:00:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:00:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:00:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:00:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:06.552482+00:00 (in 52.996346 seconds)
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:13 UTC)" (scheduled at 2024-04-22 04:00:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:19.762424+00:00 (in 6.002611 seconds)
notificationworker stdout | 2024-04-22 04:00:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:23 UTC)" (scheduled at 2024-04-22 04:00:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 13, 760107), True, datetime.datetime(2024, 4, 22, 4, 0, 13, 760107), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:00:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:44.952062+00:00 (in 29.999495 seconds)
gcworker stdout | 2024-04-22 04:00:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:44 UTC)" (scheduled at 2024-04-22 04:00:14.952062+00:00)
gcworker stdout | 2024-04-22 04:00:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548814952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:00:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:00:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:00:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:00:15,652 [278] [DEBUG] [app] Starting request: urn:request:f9874ff9-844b-4cee-9356-ead2ae8ac6ef (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:15,652 [281] [DEBUG] [app] Starting request: urn:request:2aeabc37-843e-4335-bfa5-59b0c0f61e58 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [291] [DEBUG] [app] Starting request: urn:request:66cc0352-c1f3-4d3c-9463-1777c01a236f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [291] [DEBUG] [app] Ending request: urn:request:66cc0352-c1f3-4d3c-9463-1777c01a236f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:66cc0352-c1f3-4d3c-9463-1777c01a236f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [284] [DEBUG] [app] Starting request: urn:request:9c8a9d14-4691-41d3-ad4f-33c84752b332 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [284] [DEBUG] [app] Ending request: urn:request:9c8a9d14-4691-41d3-ad4f-33c84752b332 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9c8a9d14-4691-41d3-ad4f-33c84752b332', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:00:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:15,659 [279] [DEBUG] [app] Starting request: urn:request:96c46685-4009-4429-aef0-ae5a28b3d4d5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:15,659 [279] [DEBUG] [app] Ending request: urn:request:96c46685-4009-4429-aef0-ae5a28b3d4d5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:96c46685-4009-4429-aef0-ae5a28b3d4d5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:00:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:15,660 [279] [DEBUG] [app] Starting request: urn:request:3303a21f-0862-4f34-a363-f27d9d44feb9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:15,660 [279] [DEBUG] [app] Ending request: urn:request:3303a21f-0862-4f34-a363-f27d9d44feb9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3303a21f-0862-4f34-a363-f27d9d44feb9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:15,674 [278] [DEBUG] [app] Ending request: urn:request:f9874ff9-844b-4cee-9356-ead2ae8ac6ef (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f9874ff9-844b-4cee-9356-ead2ae8ac6ef', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:00:15,675 [281] [DEBUG] [app] Ending request: urn:request:2aeabc37-843e-4335-bfa5-59b0c0f61e58 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2aeabc37-843e-4335-bfa5-59b0c0f61e58', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:02.556208+00:00 (in 46.003354 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:16 UTC)" (scheduled at 2024-04-22 04:00:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 16, 553285), True, datetime.datetime(2024, 4, 22, 4, 0, 16, 553285), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,563 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:00:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:00:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:47.052354+00:00 (in 29.999463 seconds)
buildlogsarchiver stdout | 2024-04-22 04:00:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:47 UTC)" (scheduled at 2024-04-22 04:00:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:00:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 0, 17, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:00:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:00:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:00:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:23.759375+00:00 (in 3.996446 seconds)
notificationworker stdout | 2024-04-22 04:00:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:19 UTC)" (scheduled at 2024-04-22 04:00:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:00:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:00:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:00:19,823 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:00:21,297 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:43.057186+00:00 (in 20.997636 seconds)
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:22 UTC)" (scheduled at 2024-04-22 04:00:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:00:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:33.759375+00:00 (in 9.999500 seconds)
notificationworker stdout | 2024-04-22 04:00:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:33 UTC)" (scheduled at 2024-04-22 04:00:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 23, 760186), True, datetime.datetime(2024, 4, 22, 4, 0, 23, 760186), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:24.361582+00:00 (in 59.999459 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:24 UTC)" (scheduled at 2024-04-22 04:00:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:00:24,898 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:00:26,609 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:00:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:35.871852+00:00 (in 8.998175 seconds)
securityworker stdout | 2024-04-22 04:00:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:56 UTC)" (scheduled at 2024-04-22 04:00:26.873109+00:00)
securityworker stdout | 2024-04-22 04:00:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:00:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:00:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:00:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 55, 26, 881624), 1, 2])
securityworker stdout | 2024-04-22 04:00:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 55, 26, 881624), 1, 2])
securityworker stdout | 2024-04-22 04:00:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:00:28,046 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:00:29,905 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:00:29,985 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:00:29,995 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:00:29,998 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:00:30,001 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:00:30,004 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:00:30,068 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:00:30,653 [278] [DEBUG] [app] Starting request: urn:request:e19dad2e-8198-45a2-b088-4dcd88c79417 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:30,653 [281] [DEBUG] [app] Starting request: urn:request:68728053-32d7-46c1-9fec-1ef398325cd4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:30,656 [292] [DEBUG] [app] Starting request: urn:request:b854f004-8b05-41ad-8180-6c723158325f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:30,656 [284] [DEBUG] [app] Starting request: urn:request:c8fbf010-3bba-4c75-b4a7-4e8f1ddab220 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:30,656 [292] [DEBUG] [app] Ending request: urn:request:b854f004-8b05-41ad-8180-6c723158325f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b854f004-8b05-41ad-8180-6c723158325f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:30,657 [284] [DEBUG] [app] Ending request: urn:request:c8fbf010-3bba-4c75-b4a7-4e8f1ddab220 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c8fbf010-3bba-4c75-b4a7-4e8f1ddab220', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:00:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:30,659 [281] [DEBUG] [app] Starting request: urn:request:f9762a49-d932-4632-b90e-c1116bf0dc21 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:30,659 [281] [DEBUG] [app] Ending request: urn:request:f9762a49-d932-4632-b90e-c1116bf0dc21 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f9762a49-d932-4632-b90e-c1116bf0dc21', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:30,660 [279] [DEBUG] [app] Starting request: urn:request:99b9ff71-d04a-4ae9-997c-ca53beb99f53 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:30,660 [279] [DEBUG] [app] Ending request: urn:request:99b9ff71-d04a-4ae9-997c-ca53beb99f53 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:99b9ff71-d04a-4ae9-997c-ca53beb99f53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:30,674 [281] [DEBUG] [app] Ending request: urn:request:68728053-32d7-46c1-9fec-1ef398325cd4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:68728053-32d7-46c1-9fec-1ef398325cd4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:00:30,674 [278] [DEBUG] [app] Ending request: urn:request:e19dad2e-8198-45a2-b088-4dcd88c79417 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e19dad2e-8198-45a2-b088-4dcd88c79417', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 04:00:30,955 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:00:32,510 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 04:00:33,718 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 04:00:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:43.759375+00:00 (in 9.999529 seconds)
notificationworker stdout | 2024-04-22 04:00:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:43 UTC)" (scheduled at 2024-04-22 04:00:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 33, 760123), True, datetime.datetime(2024, 4, 22, 4, 0, 33, 760123), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:34,032 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:00:34,222 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:00:34,601 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:00:34,607 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:00:34,610 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:00:35,324 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:56.873109+00:00 (in 21.000772 seconds)
securityworker stdout | 2024-04-22 04:00:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:05 UTC)" (scheduled at 2024-04-22 04:00:35.871852+00:00)
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:00:36,470 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:00:36,613 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:00:36,720 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:00:37,666 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:00:39,062 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:00:39,080 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:00:39,441 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:00:39,513 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:41.564959+00:00 (in 1.997436 seconds)
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:39 UTC)" (scheduled at 2024-04-22 04:00:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:00:40,751 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:00:40,886 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:00:40,889 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:00:40,895 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:00:40,897 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:00:40,902 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:00:40,904 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:00:40,907 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:00:40,909 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:00:40,912 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:00:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:00:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:11.264267+00:00 (in 29.999427 seconds)
autopruneworker stdout | 2024-04-22 04:00:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:11 UTC)" (scheduled at 2024-04-22 04:00:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:00:41,274 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758381274, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:00:41,278 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:00:41,278 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:00:41,278 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:39.566970+00:00 (in 58.001432 seconds)
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:41 UTC)" (scheduled at 2024-04-22 04:00:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:00:41,567 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 41, 565826), True, datetime.datetime(2024, 4, 22, 4, 0, 41, 565826), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:00:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:00:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:00:41,578 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:00:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:00:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:22.058978+00:00 (in 39.001266 seconds)
namespacegcworker stdout | 2024-04-22 04:00:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:43 UTC)" (scheduled at 2024-04-22 04:00:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:00:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:00:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 43, 58114), True, datetime.datetime(2024, 4, 22, 4, 0, 43, 58114), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:00:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:00:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:00:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:53.759375+00:00 (in 9.999506 seconds)
notificationworker stdout | 2024-04-22 04:00:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:53 UTC)" (scheduled at 2024-04-22 04:00:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 43, 760158), True, datetime.datetime(2024, 4, 22, 4, 0, 43, 760158), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:00:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:14.952062+00:00 (in 29.999530 seconds)
gcworker stdout | 2024-04-22 04:00:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:14 UTC)" (scheduled at 2024-04-22 04:00:44.952062+00:00)
gcworker stdout | 2024-04-22 04:00:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548844952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:00:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:00:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:00:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:00:45,652 [278] [DEBUG] [app] Starting request: urn:request:a82738b2-732a-4c1d-8646-3f7804733d1b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:45,652 [281] [DEBUG] [app] Starting request: urn:request:e19a008e-f0ff-4b01-88cd-23c1e7b1b732 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:45,653 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:45,655 [291] [DEBUG] [app] Starting request: urn:request:40a1eb52-5edc-4856-87d1-015180841cbb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [291] [DEBUG] [app] Ending request: urn:request:40a1eb52-5edc-4856-87d1-015180841cbb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:40a1eb52-5edc-4856-87d1-015180841cbb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [284] [DEBUG] [app] Starting request: urn:request:817e0ae3-b1c1-4518-a711-7d5dc5c42dba (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [284] [DEBUG] [app] Ending request: urn:request:817e0ae3-b1c1-4518-a711-7d5dc5c42dba (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:817e0ae3-b1c1-4518-a711-7d5dc5c42dba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:45,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:45,659 [282] [DEBUG] [app] Starting request: urn:request:1df67aa8-50d4-4f4b-ace5-ff9dd3561e5c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:45,659 [282] [DEBUG] [app] Ending request: urn:request:1df67aa8-50d4-4f4b-ace5-ff9dd3561e5c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1df67aa8-50d4-4f4b-ace5-ff9dd3561e5c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:00:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:45,660 [279] [DEBUG] [app] Starting request: urn:request:b8ccfe30-aec9-487b-850e-4d2262be91f3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:45,661 [279] [DEBUG] [app] Ending request: urn:request:b8ccfe30-aec9-487b-850e-4d2262be91f3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b8ccfe30-aec9-487b-850e-4d2262be91f3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:45,674 [278] [DEBUG] [app] Ending request: urn:request:a82738b2-732a-4c1d-8646-3f7804733d1b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a82738b2-732a-4c1d-8646-3f7804733d1b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:00:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:00:45,674 [281] [DEBUG] [app] Ending request: urn:request:e19a008e-f0ff-4b01-88cd-23c1e7b1b732 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e19a008e-f0ff-4b01-88cd-23c1e7b1b732', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 04:00:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:00:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:17.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 04:00:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:17 UTC)" (scheduled at 2024-04-22 04:00:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:00:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 0, 47, 53158), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:00:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:00:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:00:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:00:49,859 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:00:51,314 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:00:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:03.759375+00:00 (in 9.999435 seconds)
notificationworker stdout | 2024-04-22 04:00:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:03 UTC)" (scheduled at 2024-04-22 04:00:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 53, 760324), True, datetime.datetime(2024, 4, 22, 4, 0, 53, 760324), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:00:54,905 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:00:56,624 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:00:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:05.871852+00:00 (in 8.998253 seconds)
securityworker stdout | 2024-04-22 04:00:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:26 UTC)" (scheduled at 2024-04-22 04:00:56.873109+00:00)
securityworker stdout | 2024-04-22 04:00:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:00:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:00:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 55, 56, 881155), 1, 2])
securityworker stdout | 2024-04-22 04:00:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 55, 56, 881155), 1, 2])
securityworker stdout | 2024-04-22 04:00:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:00:58,064 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:00:59,942 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:00:59,994 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:01:00,002 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:01:00,005 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:01:00,008 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:01:00,010 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:01:00,104 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:01:00,653 [278] [DEBUG] [app] Starting request: urn:request:3fda7d89-6aa5-4de5-91dc-605305f50e91 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:00,653 [282] [DEBUG] [app] Starting request: urn:request:01bc93a4-1cfe-4fae-a6d3-7417a65a0888 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:00,656 [292] [DEBUG] [app] Starting request: urn:request:3815de29-0a47-4ebf-b4b6-18feb0ad510b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:00,656 [284] [DEBUG] [app] Starting request: urn:request:41c7909c-8961-4802-a6a4-ba78d7c49c6a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [284] [DEBUG] [app] Ending request: urn:request:41c7909c-8961-4802-a6a4-ba78d7c49c6a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:41c7909c-8961-4802-a6a4-ba78d7c49c6a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [292] [DEBUG] [app] Ending request: urn:request:3815de29-0a47-4ebf-b4b6-18feb0ad510b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3815de29-0a47-4ebf-b4b6-18feb0ad510b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:00,660 [278] [DEBUG] [app] Starting request: urn:request:a764352a-9a46-41a7-889e-fce4226c01a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:00,660 [281] [DEBUG] [app] Starting request: urn:request:31376015-3630-443e-bdc8-ab81cac8c7ca (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:00,660 [278] [DEBUG] [app] Ending request: urn:request:a764352a-9a46-41a7-889e-fce4226c01a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a764352a-9a46-41a7-889e-fce4226c01a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:00,660 [281] [DEBUG] [app] Ending request: urn:request:31376015-3630-443e-bdc8-ab81cac8c7ca (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:31376015-3630-443e-bdc8-ab81cac8c7ca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:01:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:00,675 [282] [DEBUG] [app] Ending request: urn:request:01bc93a4-1cfe-4fae-a6d3-7417a65a0888 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:01bc93a4-1cfe-4fae-a6d3-7417a65a0888', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:00,676 [278] [DEBUG] [app] Ending request: urn:request:3fda7d89-6aa5-4de5-91dc-605305f50e91 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3fda7d89-6aa5-4de5-91dc-605305f50e91', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:01:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:01:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:01:00,978 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:01:02,547 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:16.552337+00:00 (in 13.995617 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:02 UTC)" (scheduled at 2024-04-22 04:01:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:01:03,755 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 04:01:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:13.759375+00:00 (in 9.999526 seconds)
notificationworker stdout | 2024-04-22 04:01:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:13 UTC)" (scheduled at 2024-04-22 04:01:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 3, 760128), True, datetime.datetime(2024, 4, 22, 4, 1, 3, 760128), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:01:04,069 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:01:04,259 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:01:04,609 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:01:04,614 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:01:04,617 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:01:05,361 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:26.873109+00:00 (in 21.000802 seconds)
securityworker stdout | 2024-04-22 04:01:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:35 UTC)" (scheduled at 2024-04-22 04:01:05.871852+00:00)
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:01:06,507 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
repositorygcworker stdout | 2024-04-22 04:01:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:01:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:13.555667+00:00 (in 7.002763 seconds)
repositorygcworker stdout | 2024-04-22 04:01:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:06 UTC)" (scheduled at 2024-04-22 04:01:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:01:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:01:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 6, 553261), True, datetime.datetime(2024, 4, 22, 4, 1, 6, 553261), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:01:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:01:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:01:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:01:06,624 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:01:06,744 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:01:07,702 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:01:09,098 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:01:09,115 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:01:09,463 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:01:09,519 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:01:10,787 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:01:10,899 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:01:10,901 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:01:10,904 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:01:10,906 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:01:10,911 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:01:10,914 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:01:10,918 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:01:10,920 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:01:10,923 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:01:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:01:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:41.264267+00:00 (in 29.999454 seconds)
autopruneworker stdout | 2024-04-22 04:01:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:41 UTC)" (scheduled at 2024-04-22 04:01:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:01:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758411272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:01:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:01:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:01:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:01:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:51.555445+00:00 (in 37.999301 seconds)
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:13 UTC)" (scheduled at 2024-04-22 04:01:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:19.762424+00:00 (in 6.002599 seconds)
notificationworker stdout | 2024-04-22 04:01:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:23 UTC)" (scheduled at 2024-04-22 04:01:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 13, 760123), True, datetime.datetime(2024, 4, 22, 4, 1, 13, 760123), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:01:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:01:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:44.952062+00:00 (in 29.999485 seconds)
gcworker stdout | 2024-04-22 04:01:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:44 UTC)" (scheduled at 2024-04-22 04:01:14.952062+00:00)
gcworker stdout | 2024-04-22 04:01:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548874953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:01:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:01:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:01:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:01:15,653 [279] [DEBUG] [app] Starting request: urn:request:478c1202-8fa8-4e40-97f8-3f423c6c8524 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:15,653 [282] [DEBUG] [app] Starting request: urn:request:0910716c-dbda-47c0-ac2e-90f42a6e6e53 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [290] [DEBUG] [app] Starting request: urn:request:8ac096e1-7964-4a7f-aa06-dd6ebac78fbc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [292] [DEBUG] [app] Starting request: urn:request:47c0139e-2f26-45bd-8374-0b233241a93c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [290] [DEBUG] [app] Ending request: urn:request:8ac096e1-7964-4a7f-aa06-dd6ebac78fbc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8ac096e1-7964-4a7f-aa06-dd6ebac78fbc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [292] [DEBUG] [app] Ending request: urn:request:47c0139e-2f26-45bd-8374-0b233241a93c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47c0139e-2f26-45bd-8374-0b233241a93c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:15,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:01:15,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:01:15,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:15,660 [279] [DEBUG] [app] Starting request: urn:request:b59c1a87-8f82-44b9-98f3-21861b9ee046 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:15,660 [278] [DEBUG] [app] Starting request: urn:request:d841d39c-0ca1-45cf-bd20-db92e8be8ce6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:15,660 [279] [DEBUG] [app] Ending request: urn:request:b59c1a87-8f82-44b9-98f3-21861b9ee046 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b59c1a87-8f82-44b9-98f3-21861b9ee046', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:15,661 [278] [DEBUG] [app] Ending request: urn:request:d841d39c-0ca1-45cf-bd20-db92e8be8ce6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d841d39c-0ca1-45cf-bd20-db92e8be8ce6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:15,675 [282] [DEBUG] [app] Ending request: urn:request:0910716c-dbda-47c0-ac2e-90f42a6e6e53 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0910716c-dbda-47c0-ac2e-90f42a6e6e53', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:01:15,675 [279] [DEBUG] [app] Ending request: urn:request:478c1202-8fa8-4e40-97f8-3f423c6c8524 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:478c1202-8fa8-4e40-97f8-3f423c6c8524', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:02.556208+00:00 (in 46.003309 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:16 UTC)" (scheduled at 2024-04-22 04:01:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 16, 553334), True, datetime.datetime(2024, 4, 22, 4, 1, 16, 553334), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:01:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:01:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:47.052354+00:00 (in 29.999425 seconds)
buildlogsarchiver stdout | 2024-04-22 04:01:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:47 UTC)" (scheduled at 2024-04-22 04:01:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:01:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 1, 17, 53312), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:01:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:01:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:01:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:23.759375+00:00 (in 3.996423 seconds)
notificationworker stdout | 2024-04-22 04:01:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:19 UTC)" (scheduled at 2024-04-22 04:01:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:01:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:01:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:01:19,895 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:01:21,328 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:43.057186+00:00 (in 20.997687 seconds)
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:22 UTC)" (scheduled at 2024-04-22 04:01:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:33.759375+00:00 (in 9.999449 seconds)
notificationworker stdout | 2024-04-22 04:01:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:33 UTC)" (scheduled at 2024-04-22 04:01:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 23, 760278), True, datetime.datetime(2024, 4, 22, 4, 1, 23, 760278), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:24.361582+00:00 (in 59.999453 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:24 UTC)" (scheduled at 2024-04-22 04:01:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:01:24,941 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:01:26,658 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:01:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:35.871852+00:00 (in 8.998242 seconds)
securityworker stdout | 2024-04-22 04:01:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:56 UTC)" (scheduled at 2024-04-22 04:01:26.873109+00:00)
securityworker stdout | 2024-04-22 04:01:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:01:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:01:26,878 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:01:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 56, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 04:01:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 56, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 04:01:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:01:28,072 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:01:29,976 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:01:30,002 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:01:30,009 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:01:30,012 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:01:30,015 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:01:30,017 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:01:30,128 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:01:30,653 [278] [DEBUG] [app] Starting request: urn:request:5cda411c-06c3-4a36-a83a-1a8bf0d6cb39 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:30,653 [281] [DEBUG] [app] Starting request: urn:request:3335e451-42aa-4693-bde6-92e5afcd7c24 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:30,656 [291] [DEBUG] [app] Starting request: urn:request:8476cb3c-75db-4261-ab2a-c59b55c20651 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:30,656 [291] [DEBUG] [app] Ending request: urn:request:8476cb3c-75db-4261-ab2a-c59b55c20651 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8476cb3c-75db-4261-ab2a-c59b55c20651', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:30,656 [290] [DEBUG] [app] Starting request: urn:request:c591ea98-e3ac-47e6-9e60-82b582032a02 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:01:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:01:30,657 [290] [DEBUG] [app] Ending request: urn:request:c591ea98-e3ac-47e6-9e60-82b582032a02 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c591ea98-e3ac-47e6-9e60-82b582032a02', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:01:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:01:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:30,659 [278] [DEBUG] [app] Starting request: urn:request:a10e861e-1c01-476d-8102-0ac1240b0bdf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:30,659 [278] [DEBUG] [app] Ending request: urn:request:a10e861e-1c01-476d-8102-0ac1240b0bdf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a10e861e-1c01-476d-8102-0ac1240b0bdf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:30,660 [279] [DEBUG] [app] Starting request: urn:request:9409842f-eb90-4a06-adec-dd1b93d30a1f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:30,660 [279] [DEBUG] [app] Ending request: urn:request:9409842f-eb90-4a06-adec-dd1b93d30a1f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9409842f-eb90-4a06-adec-dd1b93d30a1f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:30,675 [278] [DEBUG] [app] Ending request: urn:request:5cda411c-06c3-4a36-a83a-1a8bf0d6cb39 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5cda411c-06c3-4a36-a83a-1a8bf0d6cb39', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:01:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:01:30,675 [281] [DEBUG] [app] Ending request: urn:request:3335e451-42aa-4693-bde6-92e5afcd7c24 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3335e451-42aa-4693-bde6-92e5afcd7c24', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:01:30,997 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:01:32,568 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:01:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:43.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:01:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:43 UTC)" (scheduled at 2024-04-22 04:01:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 33, 760445), True, datetime.datetime(2024, 4, 22, 4, 1, 33, 760445), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:01:33,790 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:01:34,100 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:01:34,295 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:01:34,617 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:01:34,622 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:01:34,625 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:01:35,395 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:01:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:56.873109+00:00 (in 21.000783 seconds)
securityworker stdout | 2024-04-22 04:01:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:05 UTC)" (scheduled at 2024-04-22 04:01:35.871852+00:00)
securityworker stdout | 2024-04-22 04:01:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:01:36,524 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:01:36,660 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:01:36,753 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:01:37,738 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:01:39,118 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:01:39,145 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:01:39,491 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:01:39,552 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:41.564959+00:00 (in 1.997482 seconds)
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:39 UTC)" (scheduled at 2024-04-22 04:01:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:01:40,824 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:01:40,909 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:01:40,912 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:01:40,915 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:01:40,918 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:01:40,921 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:01:40,925 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:01:40,928 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:01:40,930 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:01:40,933 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:01:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:01:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:11.264267+00:00 (in 29.999441 seconds)
autopruneworker stdout | 2024-04-22 04:01:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:11 UTC)" (scheduled at 2024-04-22 04:01:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:01:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758441272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:01:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:01:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:01:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:53.566665+00:00 (in 12.001150 seconds)
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:41 UTC)" (scheduled at 2024-04-22 04:01:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:01:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 41, 565817), True, datetime.datetime(2024, 4, 22, 4, 1, 41, 565817), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:01:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:01:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:01:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:01:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:01:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:22.058978+00:00 (in 39.001361 seconds)
namespacegcworker stdout | 2024-04-22 04:01:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:43 UTC)" (scheduled at 2024-04-22 04:01:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:01:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:01:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 43, 58108), True, datetime.datetime(2024, 4, 22, 4, 1, 43, 58108), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:01:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:01:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:01:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:53.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:01:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:53 UTC)" (scheduled at 2024-04-22 04:01:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 43, 760221), True, datetime.datetime(2024, 4, 22, 4, 1, 43, 760221), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:01:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:01:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:14.952062+00:00 (in 29.999523 seconds)
gcworker stdout | 2024-04-22 04:01:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:14 UTC)" (scheduled at 2024-04-22 04:01:44.952062+00:00)
gcworker stdout | 2024-04-22 04:01:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548904952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:01:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:01:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:01:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:01:45,652 [278] [DEBUG] [app] Starting request: urn:request:b30b0852-379d-4099-8a2f-3d84801b0b3a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:45,652 [282] [DEBUG] [app] Starting request: urn:request:f5c929b3-f5e7-48ca-9aab-2c7f2323e642 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [284] [DEBUG] [app] Starting request: urn:request:0255c665-9085-4203-a4a5-627a21a2d732 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [292] [DEBUG] [app] Starting request: urn:request:0af30bdd-1e49-4eb4-bebe-c3a5289e5a69 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [284] [DEBUG] [app] Ending request: urn:request:0255c665-9085-4203-a4a5-627a21a2d732 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0255c665-9085-4203-a4a5-627a21a2d732', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [292] [DEBUG] [app] Ending request: urn:request:0af30bdd-1e49-4eb4-bebe-c3a5289e5a69 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0af30bdd-1e49-4eb4-bebe-c3a5289e5a69', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:45,659 [279] [DEBUG] [app] Starting request: urn:request:67783f0f-a4ee-4dc7-a189-9cae1e9912bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:45,659 [281] [DEBUG] [app] Starting request: urn:request:7199ecb2-25f5-45dc-85c4-dd129f42f3b7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:45,659 [281] [DEBUG] [app] Ending request: urn:request:7199ecb2-25f5-45dc-85c4-dd129f42f3b7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7199ecb2-25f5-45dc-85c4-dd129f42f3b7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:45,659 [279] [DEBUG] [app] Ending request: urn:request:67783f0f-a4ee-4dc7-a189-9cae1e9912bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:67783f0f-a4ee-4dc7-a189-9cae1e9912bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:01:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:45,673 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:45,676 [278] [DEBUG] [app] Ending request: urn:request:b30b0852-379d-4099-8a2f-3d84801b0b3a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b30b0852-379d-4099-8a2f-3d84801b0b3a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:01:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:01:45,681 [282] [DEBUG] [app] Ending request: urn:request:f5c929b3-f5e7-48ca-9aab-2c7f2323e642 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f5c929b3-f5e7-48ca-9aab-2c7f2323e642', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:45,681 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:45,682 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.030)
buildlogsarchiver stdout | 2024-04-22 04:01:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:01:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:17.052354+00:00 (in 29.999476 seconds)
buildlogsarchiver stdout | 2024-04-22 04:01:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:17 UTC)" (scheduled at 2024-04-22 04:01:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:01:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 1, 47, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:01:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:01:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:01:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:01:49,906 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:01:51,348 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 04:01:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:01:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:06.552482+00:00 (in 14.996542 seconds)
repositorygcworker stdout | 2024-04-22 04:01:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:51 UTC)" (scheduled at 2024-04-22 04:01:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:01:51,557 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:01:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), True, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:01:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), True, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:01:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:01:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:01:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:01:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:39.566970+00:00 (in 45.999784 seconds)
exportactionlogsworker stdout | 2024-04-22 04:01:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:53 UTC)" (scheduled at 2024-04-22 04:01:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:01:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:01:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), True, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:01:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), True, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:01:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:01:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:03.759375+00:00 (in 9.999490 seconds)
notificationworker stdout | 2024-04-22 04:01:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:03 UTC)" (scheduled at 2024-04-22 04:01:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 53, 760325), True, datetime.datetime(2024, 4, 22, 4, 1, 53, 760325), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:01:54,978 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:01:56,694 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:01:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 04:01:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:26 UTC)" (scheduled at 2024-04-22 04:01:56.873109+00:00)
securityworker stdout | 2024-04-22 04:01:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:01:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:01:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:01:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 56, 56, 880704), 1, 2])
securityworker stdout | 2024-04-22 04:01:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 56, 56, 880704), 1, 2])
securityworker stdout | 2024-04-22 04:01:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:01:58,091 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:01:59,986 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:02:00,009 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:02:00,016 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:02:00,019 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:02:00,022 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:02:00,024 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:02:00,143 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:02:00,653 [278] [DEBUG] [app] Starting request: urn:request:6d2a01aa-5582-4720-a2fa-a61148c107be (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:00,653 [282] [DEBUG] [app] Starting request: urn:request:6e848af1-f36a-4ed0-8840-af018d82fb28 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:00,656 [292] [DEBUG] [app] Starting request: urn:request:87d1e1a6-e13d-4df5-8a42-9f803fa93e00 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:00,656 [290] [DEBUG] [app] Starting request: urn:request:1b2582c3-1e6d-4dcb-a632-c993841e59e4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [292] [DEBUG] [app] Ending request: urn:request:87d1e1a6-e13d-4df5-8a42-9f803fa93e00 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:87d1e1a6-e13d-4df5-8a42-9f803fa93e00', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [290] [DEBUG] [app] Ending request: urn:request:1b2582c3-1e6d-4dcb-a632-c993841e59e4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1b2582c3-1e6d-4dcb-a632-c993841e59e4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:02:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:00,660 [278] [DEBUG] [app] Starting request: urn:request:4c5dbdaf-8763-4269-9e0e-0cff399f50ca (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:00,660 [278] [DEBUG] [app] Ending request: urn:request:4c5dbdaf-8763-4269-9e0e-0cff399f50ca (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4c5dbdaf-8763-4269-9e0e-0cff399f50ca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:00,660 [281] [DEBUG] [app] Starting request: urn:request:7c349d85-1d6c-4505-beac-4702047de1a0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,660 [281] [DEBUG] [app] Ending request: urn:request:7c349d85-1d6c-4505-beac-4702047de1a0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7c349d85-1d6c-4505-beac-4702047de1a0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:02:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:00,675 [278] [DEBUG] [app] Ending request: urn:request:6d2a01aa-5582-4720-a2fa-a61148c107be (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6d2a01aa-5582-4720-a2fa-a61148c107be', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:00,675 [282] [DEBUG] [app] Ending request: urn:request:6e848af1-f36a-4ed0-8840-af018d82fb28 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6e848af1-f36a-4ed0-8840-af018d82fb28', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:02:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 04:02:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:02:01,010 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:16.552337+00:00 (in 13.995606 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:02 UTC)" (scheduled at 2024-04-22 04:02:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:02,594 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:02:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:13.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:02:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:13 UTC)" (scheduled at 2024-04-22 04:02:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 3, 760254), True, datetime.datetime(2024, 4, 22, 4, 2, 3, 760254), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:02:03,827 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:02:04,127 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:02:04,331 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:02:04,627 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:02:04,631 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:02:04,633 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:02:05,432 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:26.873109+00:00 (in 21.000760 seconds)
securityworker stdout | 2024-04-22 04:02:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:35 UTC)" (scheduled at 2024-04-22 04:02:05.871852+00:00)
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:02:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:02:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:13.555667+00:00 (in 7.002608 seconds)
repositorygcworker stdout | 2024-04-22 04:02:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:06 UTC)" (scheduled at 2024-04-22 04:02:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:02:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:02:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 6, 553376), True, datetime.datetime(2024, 4, 22, 4, 2, 6, 553376), 0, 'repositorygc/%', 50, 1, 0])
servicekey stdout | 2024-04-22 04:02:06,557 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
repositorygcworker stdout | 2024-04-22 04:02:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:02:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:02:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:02:06,669 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:02:06,789 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:02:07,775 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:02:09,143 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:02:09,181 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:02:09,527 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:02:09,589 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:02:10,860 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:02:10,919 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:02:10,922 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:02:10,926 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:02:10,928 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:02:10,931 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:02:10,933 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:02:10,940 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:02:10,943 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:02:10,946 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:02:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:02:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:41.264267+00:00 (in 29.999460 seconds)
autopruneworker stdout | 2024-04-22 04:02:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:41 UTC)" (scheduled at 2024-04-22 04:02:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:02:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758471272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:02:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:02:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:02:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:02:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:06.552482+00:00 (in 52.996260 seconds)
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:13 UTC)" (scheduled at 2024-04-22 04:02:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:19.762424+00:00 (in 6.002601 seconds)
notificationworker stdout | 2024-04-22 04:02:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:23 UTC)" (scheduled at 2024-04-22 04:02:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 13, 760204), True, datetime.datetime(2024, 4, 22, 4, 2, 13, 760204), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:02:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:02:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:44.952062+00:00 (in 29.999550 seconds)
gcworker stdout | 2024-04-22 04:02:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:44 UTC)" (scheduled at 2024-04-22 04:02:14.952062+00:00)
gcworker stdout | 2024-04-22 04:02:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548934952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:02:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:02:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:02:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:02:15,653 [278] [DEBUG] [app] Starting request: urn:request:cf38f18b-459e-4e2d-8a3b-80c1dbaf5a96 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:15,653 [282] [DEBUG] [app] Starting request: urn:request:af77f1fc-12f8-4324-8b42-b36b0e06d2c6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [284] [DEBUG] [app] Starting request: urn:request:b9fb0cc2-d0be-4fa0-8791-1330ad1603f4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [292] [DEBUG] [app] Starting request: urn:request:7a5efa78-3745-45e4-acbb-d28d2d41dc32 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [284] [DEBUG] [app] Ending request: urn:request:b9fb0cc2-d0be-4fa0-8791-1330ad1603f4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b9fb0cc2-d0be-4fa0-8791-1330ad1603f4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [292] [DEBUG] [app] Ending request: urn:request:7a5efa78-3745-45e4-acbb-d28d2d41dc32 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7a5efa78-3745-45e4-acbb-d28d2d41dc32', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:02:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:02:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:15,659 [278] [DEBUG] [app] Starting request: urn:request:4eb3d21f-ab27-4519-8edc-fb720a09d2fa (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:15,659 [278] [DEBUG] [app] Ending request: urn:request:4eb3d21f-ab27-4519-8edc-fb720a09d2fa (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4eb3d21f-ab27-4519-8edc-fb720a09d2fa', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:15,660 [279] [DEBUG] [app] Starting request: urn:request:7d05f4dc-77f1-400e-a800-a396d50a8f12 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:15,660 [279] [DEBUG] [app] Ending request: urn:request:7d05f4dc-77f1-400e-a800-a396d50a8f12 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7d05f4dc-77f1-400e-a800-a396d50a8f12', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:15,674 [278] [DEBUG] [app] Ending request: urn:request:cf38f18b-459e-4e2d-8a3b-80c1dbaf5a96 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cf38f18b-459e-4e2d-8a3b-80c1dbaf5a96', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:15,675 [282] [DEBUG] [app] Ending request: urn:request:af77f1fc-12f8-4324-8b42-b36b0e06d2c6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:af77f1fc-12f8-4324-8b42-b36b0e06d2c6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:02:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:21.555879+00:00 (in 5.002976 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:16 UTC)" (scheduled at 2024-04-22 04:02:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 16, 553322), True, datetime.datetime(2024, 4, 22, 4, 2, 16, 553322), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:02:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:02:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:47.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 04:02:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:47 UTC)" (scheduled at 2024-04-22 04:02:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:02:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 2, 17, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:02:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:02:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:02:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:23.759375+00:00 (in 3.996435 seconds)
notificationworker stdout | 2024-04-22 04:02:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:19 UTC)" (scheduled at 2024-04-22 04:02:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:02:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:02:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:02:19,918 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,385 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:02.556208+00:00 (in 40.999801 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:21 UTC)" (scheduled at 2024-04-22 04:02:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), True, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,569 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), True, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:38.058708+00:00 (in 15.999201 seconds)
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:22 UTC)" (scheduled at 2024-04-22 04:02:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:33.759375+00:00 (in 9.999429 seconds)
notificationworker stdout | 2024-04-22 04:02:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:33 UTC)" (scheduled at 2024-04-22 04:02:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 23, 760276), True, datetime.datetime(2024, 4, 22, 4, 2, 23, 760276), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:24.361582+00:00 (in 59.999462 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:24 UTC)" (scheduled at 2024-04-22 04:02:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:02:25,008 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:02:26,731 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:02:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:35.871852+00:00 (in 8.998220 seconds)
securityworker stdout | 2024-04-22 04:02:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:56 UTC)" (scheduled at 2024-04-22 04:02:26.873109+00:00)
securityworker stdout | 2024-04-22 04:02:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:02:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:02:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:02:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 57, 26, 880846), 1, 2])
securityworker stdout | 2024-04-22 04:02:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 57, 26, 880846), 1, 2])
securityworker stdout | 2024-04-22 04:02:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:02:28,100 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:02:30,016 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:02:30,019 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:02:30,023 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:02:30,026 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:02:30,028 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:02:30,031 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:02:30,178 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:02:30,653 [279] [DEBUG] [app] Starting request: urn:request:58551494-225e-41b9-92d0-9db3b97f796c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:30,653 [281] [DEBUG] [app] Starting request: urn:request:76ea31fb-6ddc-4a68-9185-f817797a9288 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:30,656 [284] [DEBUG] [app] Starting request: urn:request:03daf3de-74c0-4c87-9913-5d604d23c6d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:30,656 [291] [DEBUG] [app] Starting request: urn:request:249239dd-e098-4f2c-8117-3f6d55118d9a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [284] [DEBUG] [app] Ending request: urn:request:03daf3de-74c0-4c87-9913-5d604d23c6d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:03daf3de-74c0-4c87-9913-5d604d23c6d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [291] [DEBUG] [app] Ending request: urn:request:249239dd-e098-4f2c-8117-3f6d55118d9a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:249239dd-e098-4f2c-8117-3f6d55118d9a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:02:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:30,660 [278] [DEBUG] [app] Starting request: urn:request:ae87359c-c077-4bf2-b2a1-b625d9559376 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:30,660 [278] [DEBUG] [app] Ending request: urn:request:ae87359c-c077-4bf2-b2a1-b625d9559376 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ae87359c-c077-4bf2-b2a1-b625d9559376', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:30,661 [282] [DEBUG] [app] Starting request: urn:request:167bf19a-6999-4004-9535-1809f0f39e10 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:30,661 [282] [DEBUG] [app] Ending request: urn:request:167bf19a-6999-4004-9535-1809f0f39e10 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:167bf19a-6999-4004-9535-1809f0f39e10', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:30,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:30,676 [279] [DEBUG] [app] Ending request: urn:request:58551494-225e-41b9-92d0-9db3b97f796c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:58551494-225e-41b9-92d0-9db3b97f796c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:30,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:30,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:02:30,676 [281] [DEBUG] [app] Ending request: urn:request:76ea31fb-6ddc-4a68-9185-f817797a9288 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:76ea31fb-6ddc-4a68-9185-f817797a9288', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:02:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotaregistrysizeworker stdout | 2024-04-22 04:02:31,019 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:02:32,614 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:02:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:43.759375+00:00 (in 9.999505 seconds)
notificationworker stdout | 2024-04-22 04:02:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:43 UTC)" (scheduled at 2024-04-22 04:02:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 33, 760291), True, datetime.datetime(2024, 4, 22, 4, 2, 33, 760291), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:02:33,862 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:02:34,161 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:02:34,368 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:02:34,636 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:02:34,640 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:02:34,643 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:02:35,448 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:02:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:56.873109+00:00 (in 21.000736 seconds)
securityworker stdout | 2024-04-22 04:02:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:05 UTC)" (scheduled at 2024-04-22 04:02:35.871852+00:00)
securityworker stdout | 2024-04-22 04:02:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:02:36,585 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:02:36,704 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:02:36,825 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:02:37,808 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 04:02:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:02:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:43.057186+00:00 (in 4.998002 seconds)
namespacegcworker stdout | 2024-04-22 04:02:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:38 UTC)" (scheduled at 2024-04-22 04:02:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:02:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:02:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), True, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:02:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), True, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:02:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:02:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:02:39,151 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:02:39,219 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:02:39,537 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:41.564959+00:00 (in 1.997435 seconds)
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:39 UTC)" (scheduled at 2024-04-22 04:02:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:02:39,568 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:39 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:02:39,626 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:02:40,881 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:02:40,929 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:02:40,932 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:02:40,935 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:02:40,938 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:02:40,940 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:02:40,943 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:02:40,951 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:02:40,954 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:02:40,957 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:02:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:02:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:11.264267+00:00 (in 29.999506 seconds)
autopruneworker stdout | 2024-04-22 04:02:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:11 UTC)" (scheduled at 2024-04-22 04:02:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:02:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758501271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:02:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:02:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:02:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:39.566970+00:00 (in 58.001498 seconds)
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:41 UTC)" (scheduled at 2024-04-22 04:02:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:02:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 41, 565842), True, datetime.datetime(2024, 4, 22, 4, 2, 41, 565842), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:02:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:02:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:02:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:02:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:02:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:22.058978+00:00 (in 39.001215 seconds)
namespacegcworker stdout | 2024-04-22 04:02:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:43 UTC)" (scheduled at 2024-04-22 04:02:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:02:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:02:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 43, 58190), True, datetime.datetime(2024, 4, 22, 4, 2, 43, 58190), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:02:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:02:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:02:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:53.759375+00:00 (in 9.999537 seconds)
notificationworker stdout | 2024-04-22 04:02:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:53 UTC)" (scheduled at 2024-04-22 04:02:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 43, 760094), True, datetime.datetime(2024, 4, 22, 4, 2, 43, 760094), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:53 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:02:44,680 [278] [DEBUG] [app] Starting request: urn:request:44251753-5613-4e4e-b41e-7e2bb55cb1ed (/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:44,688 [278] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class <class 'endpoints.api.repository.RepositoryTrust'>
gunicorn-web stdout | 2024-04-22 04:02:44,713 [278] [DEBUG] [app] Ending request: urn:request:44251753-5613-4e4e-b41e-7e2bb55cb1ed (/) {'endpoint': 'web.index', 'request_id': 'urn:request:44251753-5613-4e4e-b41e-7e2bb55cb1ed', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/', 'path': '/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:44,714 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:44 +0000] "GET / HTTP/1.0" 200 93195 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:44 +0000] "GET / HTTP/1.1" 200 14249 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 812 0.035)
gcworker stdout | 2024-04-22 04:02:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:02:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:14.952062+00:00 (in 29.999522 seconds)
gcworker stdout | 2024-04-22 04:02:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:14 UTC)" (scheduled at 2024-04-22 04:02:44.952062+00:00)
gcworker stdout | 2024-04-22 04:02:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548964952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:02:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:02:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:02:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:14 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/font-awesome.css-a166e3c966c6.css HTTP/1.1" 200 8417 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1012 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/jquery.js-3c5c5966471e.js HTTP/1.1" 200 102811 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 990 -)
gunicorn-web stdout | 2024-04-22 04:02:45,653 [278] [DEBUG] [app] Starting request: urn:request:32f57dc0-083e-4b54-bdaa-9b321783d50b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:45,653 [281] [DEBUG] [app] Starting request: urn:request:ff2a7f63-cc35-4537-9fcf-1c7015428109 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:45,656 [292] [DEBUG] [app] Starting request: urn:request:3827dc90-0477-4401-83e2-eeb89d12d734 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:45,656 [291] [DEBUG] [app] Starting request: urn:request:173d4f14-3354-420b-a4fe-0fa013b60257 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [292] [DEBUG] [app] Ending request: urn:request:3827dc90-0477-4401-83e2-eeb89d12d734 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3827dc90-0477-4401-83e2-eeb89d12d734', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [291] [DEBUG] [app] Ending request: urn:request:173d4f14-3354-420b-a4fe-0fa013b60257 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:173d4f14-3354-420b-a4fe-0fa013b60257', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:02:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:45,660 [282] [DEBUG] [app] Starting request: urn:request:df67fdcc-c64b-4d20-987d-d1538856d096 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:45,660 [282] [DEBUG] [app] Ending request: urn:request:df67fdcc-c64b-4d20-987d-d1538856d096 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:df67fdcc-c64b-4d20-987d-d1538856d096', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:45,660 [281] [DEBUG] [app] Starting request: urn:request:9c477441-01cb-47a9-b110-e1180ce87b75 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [DEBUG] [app] Ending request: urn:request:9c477441-01cb-47a9-b110-e1180ce87b75 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9c477441-01cb-47a9-b110-e1180ce87b75', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:45,675 [281] [DEBUG] [app] Ending request: urn:request:ff2a7f63-cc35-4537-9fcf-1c7015428109 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ff2a7f63-cc35-4537-9fcf-1c7015428109', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:02:45,676 [278] [DEBUG] [app] Ending request: urn:request:32f57dc0-083e-4b54-bdaa-9b321783d50b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:32f57dc0-083e-4b54-bdaa-9b321783d50b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/ng-tags-input.min.css-7782190f81cd.css HTTP/1.1" 200 1079 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1017 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/cssfamilySourceSansPro300400700-30cd793a4b9b.css HTTP/1.1" 200 235 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1027 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.css-4b15a4ede750.css HTTP/1.1" 200 1482 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1028 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/bootstrap.min.css-13f668494557.css HTTP/1.1" 200 24440 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1013 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/cal-heatmap.css-904c3b9e8a60.css HTTP/1.1" 200 799 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1011 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootstrap.min.js-0e773844b374.js HTTP/1.1" 200 11303 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 997 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular.min.js-f0f4228b82f7.js HTTP/1.1" 200 63500 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 995 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-route.min.js-590b72b0eb88.js HTTP/1.1" 200 2248 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1001 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-sanitize.min.js-ff589de0ec1b.js HTTP/1.1" 200 3128 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1004 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-animate.min.js-636f7a51b2e1.js HTTP/1.1" 200 10309 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1003 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-cookies.min.js-2455ea25d522.js HTTP/1.1" 200 826 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1003 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/momentjs-66a52705d33f.js HTTP/1.1" 200 19477 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 989 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootstrap-datepicker.min.js-3e3d8e141d5e.js HTTP/1.1" 200 9323 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1008 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.js-6612bb423b71.js HTTP/1.1" 200 10832 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1012 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootbox4.1.0underscorejs1.5.2restangular1.2.0d3js3.3.3-6d47ddfef9c5.js HTTP/1.1" 200 71199 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1035 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/raven.min.js-ecd480647a39.js HTTP/1.1" 200 9505 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/cal-heatmap.min.js-8ffad728269a.js HTTP/1.1" 200 13004 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 999 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-recaptcha.min.js-23859fca3602.js HTTP/1.1" 200 1793 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1005 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/ldn/ng-tags-input.min.js-fa3026ba8409.js HTTP/1.1" 200 6102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1001 -)
buildlogsarchiver stdout | 2024-04-22 04:02:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:02:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:17.052354+00:00 (in 29.999407 seconds)
buildlogsarchiver stdout | 2024-04-22 04:02:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:17 UTC)" (scheduled at 2024-04-22 04:02:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:02:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 2, 47, 53283), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:02:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:02:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:02:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:17 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/ldn/typeahead.bundle.min.js-716151ca4e5d.js HTTP/1.1" 200 16673 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1004 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/build/main-quay-frontend-3d66b1aa00f3f01d8b3f.bundle.js HTTP/1.1" 200 726755 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1016 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/standalonelib/jquery.overscroll.min.js HTTP/1.1" 200 3491 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 999 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/RedHat.svg HTTP/1.1" 200 1245 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 996 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/135-quay-frontend.chunk.js HTTP/1.1" 200 975 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/18-quay-frontend.chunk.js HTTP/1.1" 200 997 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 992 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/83-quay-frontend.chunk.js HTTP/1.1" 200 1717 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 992 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/112-quay-frontend.chunk.js HTTP/1.1" 200 767 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/181-quay-frontend.chunk.js HTTP/1.1" 200 952 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/152-quay-frontend.chunk.js HTTP/1.1" 200 313 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
gunicorn-web stdout | 2024-04-22 04:02:49,405 [278] [DEBUG] [app] Starting request: urn:request:cfd6aaa0-cbd8-4cde-ac2a-91bb347f3421 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:49,405 [279] [DEBUG] [app] Starting request: urn:request:97c9f9e2-ebe6-4eeb-b92f-d25c0344de05 (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:02:49,406 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:02:49,406 [278] [DEBUG] [app] Ending request: urn:request:cfd6aaa0-cbd8-4cde-ac2a-91bb347f3421 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:cfd6aaa0-cbd8-4cde-ac2a-91bb347f3421', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:49,407 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/user/ HTTP/1.0" 401 311 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/user/ HTTP/1.1" 401 311 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.003 1106 0.003)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/RH_Logo_Quay_Black_UX-horizontal.svg HTTP/1.1" 200 3222 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1022 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/fonts/fontawesome-webfont.woff2?v=4.7.0 HTTP/1.1" 200 77160 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/static/ldn/font-awesome.css-a166e3c966c6.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1093 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/network-tile.png HTTP/1.1" 200 6289 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1002 -)
gunicorn-web stdout | 2024-04-22 04:02:49,416 [279] [DEBUG] [app] Ending request: urn:request:97c9f9e2-ebe6-4eeb-b92f-d25c0344de05 (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:97c9f9e2-ebe6-4eeb-b92f-d25c0344de05', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:49,416 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:49,417 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.013 1109 0.013)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/quay_favicon.png HTTP/1.1" 200 3558 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1022 -)
expiredappspecifictokenworker stdout | 2024-04-22 04:02:49,928 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:51,418 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:02:51,839 [282] [DEBUG] [app] Starting request: urn:request:0c562ad2-be8b-4fc6-86ea-31b924708e59 (/api/v1/signin) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:51,841 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['whuquay', 'whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,088 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,091 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,093 [282] [DEBUG] [endpoints.common] Successfully signed in as user whuquay with uuid a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,093 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,094 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,095 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,097 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:02:52,101 [282] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [97, 1, None, None, datetime.datetime(2024, 4, 22, 4, 2, 52, 94266), '10.131.0.9', '{"type": "quayauth", "useragent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"}'])
gunicorn-web stdout | 2024-04-22 04:02:52,107 [282] [DEBUG] [app] Ending request: urn:request:0c562ad2-be8b-4fc6-86ea-31b924708e59 (/api/v1/signin) {'endpoint': 'api.signin', 'request_id': 'urn:request:0c562ad2-be8b-4fc6-86ea-31b924708e59', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/signin', 'path': '/api/v1/signin', 'parameters': {}, 'json_body': {'username': 'whuquay', 'password': '[FILTERED]'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,108 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:52,108 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "POST /api/v1/signin HTTP/1.0" 200 18 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "POST /api/v1/signin HTTP/1.1" 200 18 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.271 1339 0.270)
gunicorn-web stdout | 2024-04-22 04:02:52,464 [278] [DEBUG] [app] Starting request: urn:request:641cac1c-66ee-4748-9d09-6aeeb0f3f79c (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,464 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,465 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,466 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,475 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,475 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,475 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,477 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:02:52,482 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,483 [278] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:02:52,486 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:02:52,489 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,492 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:02:52,494 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,497 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:02:52,499 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,501 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,501 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,501 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,502 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,502 [278] [DEBUG] [app] Ending request: urn:request:641cac1c-66ee-4748-9d09-6aeeb0f3f79c (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:641cac1c-66ee-4748-9d09-6aeeb0f3f79c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,503 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:52,503 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/ HTTP/1.0" 200 726 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/ HTTP/1.1" 200 726 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.040 1377 0.040)
gunicorn-web stdout | 2024-04-22 04:02:52,824 [278] [DEBUG] [app] Starting request: urn:request:4fe81016-02a0-4a76-919a-468f64adb27c (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,824 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,824 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,825 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,827 [282] [DEBUG] [app] Starting request: urn:request:b63b34f3-a2c5-4c59-8634-aaaf8473d617 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,828 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,828 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,828 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,835 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 14, 52, 834975), datetime.datetime(2024, 4, 22, 4, 2, 52, 835036)])
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,837 [278] [DEBUG] [app] Ending request: urn:request:4fe81016-02a0-4a76-919a-468f64adb27c (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:4fe81016-02a0-4a76-919a-468f64adb27c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,838 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:52,838 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1419 0.015)
gunicorn-web stdout | 2024-04-22 04:02:52,839 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:02:52,844 [282] [DEBUG] [app] Ending request: urn:request:b63b34f3-a2c5-4c59-8634-aaaf8473d617 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:b63b34f3-a2c5-4c59-8634-aaaf8473d617', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,844 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1410 0.019)
gunicorn-web stdout | 2024-04-22 04:02:52,845 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [app] Starting request: urn:request:b8448e19-6c48-4b51-b7f5-2d815fac15fa (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,990 [279] [DEBUG] [app] Starting request: urn:request:7d0fae4a-c7ca-4504-9143-aa21b029a754 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:02:52,990 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,990 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,991 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,998 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,998 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,998 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,999 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,999 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:53,000 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:53,000 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:53,000 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:02:53,002 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:02:53,004 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:02:53,004 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE ((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) ORDER BY rid LIMIT %s', [3, 1, 'whuquay', 101])
gunicorn-web stdout | 2024-04-22 04:02:53,008 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:02:53,009 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:02:53,011 [279] [DEBUG] [app] Ending request: urn:request:7d0fae4a-c7ca-4504-9143-aa21b029a754 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:7d0fae4a-c7ca-4504-9143-aa21b029a754', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&popularity=true&starred=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'popularity': 'true', 'starred': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:53,011 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:53,012 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1461 0.023)
gunicorn-web stdout | 2024-04-22 04:02:53,012 [282] [DEBUG] [app] Ending request: urn:request:b8448e19-6c48-4b51-b7f5-2d815fac15fa (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:b8448e19-6c48-4b51-b7f5-2d815fac15fa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'whuquay', 'popularity': 'true', 'quota': 'true', 'state': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:53,013 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:53,013 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1488 0.025)
notificationworker stdout | 2024-04-22 04:02:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:03.759375+00:00 (in 9.999537 seconds)
notificationworker stdout | 2024-04-22 04:02:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:03 UTC)" (scheduled at 2024-04-22 04:02:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 53, 760243), True, datetime.datetime(2024, 4, 22, 4, 2, 53, 760243), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:02:55,045 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:02:56,767 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:02:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:05.871852+00:00 (in 8.998224 seconds)
securityworker stdout | 2024-04-22 04:02:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:26 UTC)" (scheduled at 2024-04-22 04:02:56.873109+00:00)
securityworker stdout | 2024-04-22 04:02:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:02:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:02:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 57, 56, 880795), 1, 2])
securityworker stdout | 2024-04-22 04:02:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 57, 56, 880795), 1, 2])
securityworker stdout | 2024-04-22 04:02:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:26 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:56 +0000] "GET /static/build/489e5e00e1a9a80f88d55281894a87ff.woff HTTP/1.1" 200 7280 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1344 -)
repositorygcworker stdout | 2024-04-22 04:02:58,129 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:03:00,024 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:03:00,027 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:03:00,030 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:03:00,034 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:03:00,037 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:03:00,040 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:03:00,192 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:03:00,653 [278] [DEBUG] [app] Starting request: urn:request:2e5206f7-ebd0-44ff-95bc-c368cc336a14 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:00,653 [282] [DEBUG] [app] Starting request: urn:request:56cba09a-eea7-46f9-9631-46f0adfbf6a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:00,656 [292] [DEBUG] [app] Starting request: urn:request:aa2c8b15-da4d-474d-b48f-c9d5cefb5b41 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [291] [DEBUG] [app] Starting request: urn:request:4313fdb3-e764-40c1-87e2-579046dce6c9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [292] [DEBUG] [app] Ending request: urn:request:aa2c8b15-da4d-474d-b48f-c9d5cefb5b41 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:aa2c8b15-da4d-474d-b48f-c9d5cefb5b41', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [291] [DEBUG] [app] Ending request: urn:request:4313fdb3-e764-40c1-87e2-579046dce6c9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4313fdb3-e764-40c1-87e2-579046dce6c9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:00,660 [278] [DEBUG] [app] Starting request: urn:request:d4de515b-95d1-4dcc-bc92-599b79f878ae (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:00,660 [281] [DEBUG] [app] Starting request: urn:request:d3da8de9-62c2-46f4-8e60-f2f891b1bf69 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:00,661 [278] [DEBUG] [app] Ending request: urn:request:d4de515b-95d1-4dcc-bc92-599b79f878ae (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d4de515b-95d1-4dcc-bc92-599b79f878ae', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:00,661 [281] [DEBUG] [app] Ending request: urn:request:d3da8de9-62c2-46f4-8e60-f2f891b1bf69 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d3da8de9-62c2-46f4-8e60-f2f891b1bf69', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:00,675 [282] [DEBUG] [app] Ending request: urn:request:56cba09a-eea7-46f9-9631-46f0adfbf6a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:56cba09a-eea7-46f9-9631-46f0adfbf6a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:03:00,676 [278] [DEBUG] [app] Ending request: urn:request:2e5206f7-ebd0-44ff-95bc-c368cc336a14 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2e5206f7-ebd0-44ff-95bc-c368cc336a14', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:03:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:03:01,027 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:16.552337+00:00 (in 13.995601 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:02 UTC)" (scheduled at 2024-04-22 04:03:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:02,631 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:03:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:13.759375+00:00 (in 9.999534 seconds)
notificationworker stdout | 2024-04-22 04:03:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:13 UTC)" (scheduled at 2024-04-22 04:03:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 3, 760129), True, datetime.datetime(2024, 4, 22, 4, 3, 3, 760129), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:03:03,898 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:03:04,181 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:03:04,403 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:03:04,644 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:03:04,648 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:03:04,654 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:03:05,456 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:03:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:26.873109+00:00 (in 21.000759 seconds)
securityworker stdout | 2024-04-22 04:03:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:35 UTC)" (scheduled at 2024-04-22 04:03:05.871852+00:00)
securityworker stdout | 2024-04-22 04:03:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:35 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:06,515 [281] [DEBUG] [app] Starting request: urn:request:c8f54bcb-1241-4d4e-96e5-d6a85fd4d398 (/api/v1/organization/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:06,515 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,515 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,516 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,526 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:06,526 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:06,526 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,528 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,531 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,534 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['build_test', 'bogus1@bougs.com', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,536 [281] [DEBUG] [data.model.user] Email and username are unique!
gunicorn-web stdout | 2024-04-22 04:03:06,537 [281] [DEBUG] [peewee] ('INSERT INTO "user" ("uuid", "username", "email", "verified", "organization", "robot", "invoice_email", "invalid_login_attempts", "last_invalid_login", "removed_tag_expiration_s", "enabled", "maximum_queued_builds_count", "creation_date") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "user"."id"', ['eb4c7b0e-ee31-410e-9967-c2d6258495e4', 'build_test', 'bogus1@bougs.com', False, False, False, False, 0, datetime.datetime(2024, 4, 22, 4, 3, 6, 536899), 1209600, True, None, datetime.datetime(2024, 4, 22, 4, 3, 6, 536902)])
gunicorn-web stdout | 2024-04-22 04:03:06,538 [281] [DEBUG] [peewee] ('UPDATE "user" SET "uuid" = %s, "username" = %s, "email" = %s, "verified" = %s, "organization" = %s, "robot" = %s, "invoice_email" = %s, "invalid_login_attempts" = %s, "last_invalid_login" = %s, "removed_tag_expiration_s" = %s, "enabled" = %s, "maximum_queued_builds_count" = %s, "creation_date" = %s WHERE ("user"."id" = %s)', ['eb4c7b0e-ee31-410e-9967-c2d6258495e4', 'build_test', 'bogus1@bougs.com', False, True, False, False, 0, datetime.datetime(2024, 4, 22, 4, 3, 6, 536899), 1209600, True, None, datetime.datetime(2024, 4, 22, 4, 3, 6, 536902), 2])
gunicorn-web stdout | 2024-04-22 04:03:06,539 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['admin', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,541 [281] [DEBUG] [peewee] ('INSERT INTO "team" ("name", "organization_id", "role_id", "description") VALUES (%s, %s, %s, %s) RETURNING "team"."id"', ['owners', 2, 1, ''])
gunicorn-web stdout | 2024-04-22 04:03:06,543 [281] [DEBUG] [peewee] ('INSERT INTO "teammember" ("user_id", "team_id") VALUES (%s, %s) RETURNING "teammember"."id"', [1, 1])
gunicorn-web stdout | 2024-04-22 04:03:06,548 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,550 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', [])
repositorygcworker stdout | 2024-04-22 04:03:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:03:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:13.555667+00:00 (in 7.002692 seconds)
repositorygcworker stdout | 2024-04-22 04:03:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:06 UTC)" (scheduled at 2024-04-22 04:03:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:03:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
gunicorn-web stdout | 2024-04-22 04:03:06,553 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [80, 2, 1, None, datetime.datetime(2024, 4, 22, 4, 3, 6, 547431), '10.131.0.9', '{"email": "bogus1@bougs.com", "namespace": "build_test"}'])
repositorygcworker stdout | 2024-04-22 04:03:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 6, 553366), True, datetime.datetime(2024, 4, 22, 4, 3, 6, 553366), 0, 'repositorygc/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,560 [281] [DEBUG] [app] Ending request: urn:request:c8f54bcb-1241-4d4e-96e5-d6a85fd4d398 (/api/v1/organization/) {'endpoint': 'api.organizationlist', 'request_id': 'urn:request:c8f54bcb-1241-4d4e-96e5-d6a85fd4d398', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/', 'path': '/api/v1/organization/', 'parameters': {}, 'json_body': {'name': 'build_test', 'email': 'bogus1@bougs.com'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:06,561 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:06,561 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:06 +0000] "POST /api/v1/organization/ HTTP/1.0" 201 10 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:06 +0000] "POST /api/v1/organization/ HTTP/1.1" 201 10 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.047 1639 0.047)
repositorygcworker stdout | 2024-04-22 04:03:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:03:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:03:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:03:06,620 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:03:06,734 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:03:06,861 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:03:06,888 [282] [DEBUG] [app] Starting request: urn:request:de451a7b-c695-4e36-8704-8bb1ab57f989 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:06,888 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,888 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,889 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [app] Starting request: urn:request:af16916c-1eba-4f26-952d-9afafd6b82eb (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,900 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:06,904 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,904 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:06,905 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:06,905 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,905 [282] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:03:06,905 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,907 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,909 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:06,910 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,912 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:06,913 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:06,914 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,915 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:06,917 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:06,917 [281] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:06,919 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,920 [281] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:06,921 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,921 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,921 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,922 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,922 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,922 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:06,922 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:06,924 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,926 [282] [DEBUG] [app] Ending request: urn:request:de451a7b-c695-4e36-8704-8bb1ab57f989 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:de451a7b-c695-4e36-8704-8bb1ab57f989', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:06,926 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:06,927 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/user/ HTTP/1.0" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/user/ HTTP/1.1" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1442 0.039)
gunicorn-web stdout | 2024-04-22 04:03:06,927 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:06,929 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,932 [281] [DEBUG] [app] Ending request: urn:request:af16916c-1eba-4f26-952d-9afafd6b82eb (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:af16916c-1eba-4f26-952d-9afafd6b82eb', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:06,932 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1465 0.039)
gunicorn-web stdout | 2024-04-22 04:03:06,932 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:07,243 [282] [DEBUG] [app] Starting request: urn:request:0a1e3702-c6ae-41ce-9457-5902bf8b72b4 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,243 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,243 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,244 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [app] Starting request: urn:request:573cec31-2315-466b-a34f-5412bebbe018 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,255 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 15, 7, 254849), datetime.datetime(2024, 4, 22, 4, 3, 7, 254901)])
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,257 [282] [DEBUG] [app] Ending request: urn:request:0a1e3702-c6ae-41ce-9457-5902bf8b72b4 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:0a1e3702-c6ae-41ce-9457-5902bf8b72b4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,258 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,258 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,258 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1469 0.016)
gunicorn-web stdout | 2024-04-22 04:03:07,258 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:07,259 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:03:07,264 [281] [DEBUG] [app] Ending request: urn:request:573cec31-2315-466b-a34f-5412bebbe018 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:573cec31-2315-466b-a34f-5412bebbe018', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,265 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,265 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1460 0.018)
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [app] Starting request: urn:request:246f8087-ca60-4c74-8c37-395ef16b66aa (/api/v1/organization/build_test/proxycache) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,306 [278] [DEBUG] [app] Starting request: urn:request:f9092949-bf9a-49e0-b1ad-421d619745ca (/api/v1/organization/build_test/quota) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:07,307 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,307 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,307 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,315 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,315 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,315 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,317 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:07,318 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,321 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,322 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,324 [282] [DEBUG] [app] Ending request: urn:request:246f8087-ca60-4c74-8c37-395ef16b66aa (/api/v1/organization/build_test/proxycache) {'endpoint': 'api.organizationproxycacheconfig', 'request_id': 'urn:request:246f8087-ca60-4c74-8c37-395ef16b66aa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/proxycache', 'path': '/api/v1/organization/build_test/proxycache', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,324 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,324 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:07,325 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.0" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.1" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1476 0.019)
gunicorn-web stdout | 2024-04-22 04:03:07,327 [278] [DEBUG] [app] Ending request: urn:request:f9092949-bf9a-49e0-b1ad-421d619745ca (/api/v1/organization/build_test/quota) {'endpoint': 'api.organizationquotalist', 'request_id': 'urn:request:f9092949-bf9a-49e0-b1ad-421d619745ca', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/quota', 'path': '/api/v1/organization/build_test/quota', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,327 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,327 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.0" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.1" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1471 0.022)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /static/img/creditcards/credit.png HTTP/1.1" 200 1776 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1382 -)
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [app] Starting request: urn:request:e6f40bdf-ae25-4bce-8261-e7ebf636f28b (/api/v1/organization/build_test/prototypes) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,367 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,374 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" LEFT OUTER JOIN "user" AS "t2" ON ("t2"."id" = "t1"."activating_user_id") LEFT OUTER JOIN "user" AS "t3" ON ("t3"."id" = "t1"."delegate_user_id") LEFT OUTER JOIN "team" AS "t4" ON ("t4"."id" = "t1"."delegate_team_id") LEFT OUTER JOIN "role" AS "t5" ON ("t5"."id" = "t1"."role_id") WHERE ("t1"."org_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:07,378 [278] [DEBUG] [app] Ending request: urn:request:e6f40bdf-ae25-4bce-8261-e7ebf636f28b (/api/v1/organization/build_test/prototypes) {'endpoint': 'api.permissionprototypelist', 'request_id': 'urn:request:e6f40bdf-ae25-4bce-8261-e7ebf636f28b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/prototypes', 'path': '/api/v1/organization/build_test/prototypes', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,378 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,378 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.0" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.1" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1509 0.022)
gunicorn-web stdout | 2024-04-22 04:03:07,567 [282] [DEBUG] [app] Starting request: urn:request:f55df2ce-5525-4a8d-946b-d411195b1821 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,567 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,568 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,568 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,580 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,583 [282] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 1, 3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:07,588 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:07,590 [282] [DEBUG] [app] Ending request: urn:request:f55df2ce-5525-4a8d-946b-d411195b1821 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:f55df2ce-5525-4a8d-946b-d411195b1821', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'popularity': 'true', 'public': 'true', 'quota': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,591 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,591 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1564 0.024)
blobuploadcleanupworker stdout | 2024-04-22 04:03:07,846 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:03:09,181 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:03:09,236 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:03:09,568 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:03:09,662 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /react/?_=1713758589563 HTTP/1.1" 302 145 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1485 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /?_=1713758589563 HTTP/1.1" 200 402 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1496 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /main.css HTTP/1.1" 200 2890 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1360 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /main.bundle.js HTTP/1.1" 200 229483 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1352 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /vendor.css HTTP/1.1" 200 220125 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1362 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /vendor.bundle.js HTTP/1.1" 200 556250 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1354 -)
storagereplication stdout | 2024-04-22 04:03:10,918 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:03:10,937 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:03:10,942 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:03:10,944 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:03:10,949 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:03:10,953 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:03:10,955 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:03:10,961 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:03:10,964 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:03:10,967 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:03:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:03:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:41.264267+00:00 (in 29.999516 seconds)
autopruneworker stdout | 2024-04-22 04:03:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:41 UTC)" (scheduled at 2024-04-22 04:03:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:03:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758531271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:03:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:03:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:03:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:41 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:13 +0000] "GET /images/favicon.png HTTP/1.1" 200 15998 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1396 -)
repositorygcworker stdout | 2024-04-22 04:03:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:06.552482+00:00 (in 52.996364 seconds)
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:13 UTC)" (scheduled at 2024-04-22 04:03:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:13,747 [281] [DEBUG] [app] Starting request: urn:request:48ae8636-4984-4422-bf73-1843230fc037 (/csrf_token) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:13,747 [281] [DEBUG] [app] Ending request: urn:request:48ae8636-4984-4422-bf73-1843230fc037 (/csrf_token) {'endpoint': 'web.csrf_token', 'request_id': 'urn:request:48ae8636-4984-4422-bf73-1843230fc037', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/csrf_token', 'path': '/csrf_token', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.1" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.002 1427 0.002)
gunicorn-web stdout | 2024-04-22 04:03:13,748 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.0" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:13,750 [278] [DEBUG] [app] Starting request: urn:request:bdc6e60b-0641-4d68-bd62-86bd9ad702c4 (/csrf_token) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:13,751 [278] [DEBUG] [app] Ending request: urn:request:bdc6e60b-0641-4d68-bd62-86bd9ad702c4 (/csrf_token) {'endpoint': 'web.csrf_token', 'request_id': 'urn:request:bdc6e60b-0641-4d68-bd62-86bd9ad702c4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/csrf_token', 'path': '/csrf_token', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.1" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.002 1427 0.002)
gunicorn-web stdout | 2024-04-22 04:03:13,751 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.0" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
notificationworker stdout | 2024-04-22 04:03:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:19.762160+00:00 (in 6.002293 seconds)
notificationworker stdout | 2024-04-22 04:03:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:23 UTC)" (scheduled at 2024-04-22 04:03:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 13, 760286), True, datetime.datetime(2024, 4, 22, 4, 3, 13, 760286), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:13,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:13,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:14,062 [282] [DEBUG] [app] Starting request: urn:request:7f569b8f-1ab8-4062-81fe-5f1b0791cdda (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:14,063 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,063 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,064 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,066 [281] [DEBUG] [app] Starting request: urn:request:f01a696c-69a9-4ba4-8c1f-3e24c97bc2fe (/config) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:14,066 [281] [DEBUG] [app] Ending request: urn:request:f01a696c-69a9-4ba4-8c1f-3e24c97bc2fe (/config) {'endpoint': 'web.config', 'request_id': 'urn:request:f01a696c-69a9-4ba4-8c1f-3e24c97bc2fe', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/config', 'path': '/config', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:14 +0000] "GET /config HTTP/1.1" 200 3660 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.002 1503 0.002)
gunicorn-web stdout | 2024-04-22 04:03:14,067 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:14 +0000] "GET /config HTTP/1.0" 200 3660 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:14,073 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,075 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:14,079 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,080 [282] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:03:14,082 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:03:14,085 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,087 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:14,090 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,092 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:14,094 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,096 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,097 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,098 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,102 [282] [DEBUG] [app] Ending request: urn:request:7f569b8f-1ab8-4062-81fe-5f1b0791cdda (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:7f569b8f-1ab8-4062-81fe-5f1b0791cdda', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:14,103 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:14,103 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:14 +0000] "GET /api/v1/user/ HTTP/1.0" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:14 +0000] "GET /api/v1/user/ HTTP/1.1" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.042 1509 0.042)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:14 +0000] "GET /assets/RedHatText-Regular..woff2 HTTP/1.1" 200 25844 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/vendor.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1432 -)
gcworker stdout | 2024-04-22 04:03:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:03:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:44.952062+00:00 (in 29.999514 seconds)
gcworker stdout | 2024-04-22 04:03:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:44 UTC)" (scheduled at 2024-04-22 04:03:14.952062+00:00)
gcworker stdout | 2024-04-22 04:03:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548994952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:03:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:03:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:03:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:15,151 [278] [DEBUG] [app] Starting request: urn:request:d8851e3f-9ec9-4b0a-a428-c011bc5a05fa (/api/v1/superuser/organizations/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,152 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,152 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,152 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /assets/RedHatDisplay-Medium..woff2 HTTP/1.1" 200 26664 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/vendor.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1415 -)
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [endpoints.api] Checking fresh login for user whuquay: Last login at 2024-04-22 04:02:52+00:00
gunicorn-web stdout | 2024-04-22 04:03:15,161 [281] [DEBUG] [app] Starting request: urn:request:552dc01d-321f-4606-8046-4587fcb4dffb (/api/v1/superuser/users/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,161 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,162 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:15,162 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))', [True, False])
gunicorn-web stdout | 2024-04-22 04:03:15,165 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:15,168 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,170 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:15,171 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,171 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,171 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [endpoints.api] Checking fresh login for user whuquay: Last login at 2024-04-22 04:02:52+00:00
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,172 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:15,173 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))', [False, False])
gunicorn-web stdout | 2024-04-22 04:03:15,174 [278] [DEBUG] [app] Ending request: urn:request:d8851e3f-9ec9-4b0a-a428-c011bc5a05fa (/api/v1/superuser/organizations/) {'endpoint': 'api.superuserorganizationlist', 'request_id': 'urn:request:d8851e3f-9ec9-4b0a-a428-c011bc5a05fa', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/superuser/organizations/', 'path': '/api/v1/superuser/organizations/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,175 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,175 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/organizations/ HTTP/1.0" 200 355 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/organizations/ HTTP/1.1" 200 355 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1505 0.025)
gunicorn-web stdout | 2024-04-22 04:03:15,176 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:15,178 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,180 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:15,183 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,185 [281] [DEBUG] [app] Ending request: urn:request:552dc01d-321f-4606-8046-4587fcb4dffb (/api/v1/superuser/users/) {'endpoint': 'api.superuserlist', 'request_id': 'urn:request:552dc01d-321f-4606-8046-4587fcb4dffb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/superuser/users/', 'path': '/api/v1/superuser/users/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,186 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,186 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/users/ HTTP/1.0" 200 440 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/users/ HTTP/1.1" 200 440 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1497 0.026)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /assets/RedHatText-Medium..woff2 HTTP/1.1" 200 26880 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/vendor.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1412 -)
gunicorn-web stdout | 2024-04-22 04:03:15,506 [279] [DEBUG] [app] Starting request: urn:request:574044ba-556c-408f-8a8c-38a7322231f4 (/api/v1/organization/build_test/members) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,506 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,506 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,507 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,515 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,515 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,515 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,517 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:15,520 [279] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,520 [279] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,521 [279] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,521 [279] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:15,521 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,524 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "teammember" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t3"."user_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:15,528 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t1"."user_id" = "t3"."id") WHERE (("t2"."namespace_user_id" = %s) AND ("t3"."robot" = %s))', [2, False])
gunicorn-web stdout | 2024-04-22 04:03:15,531 [279] [DEBUG] [app] Ending request: urn:request:574044ba-556c-408f-8a8c-38a7322231f4 (/api/v1/organization/build_test/members) {'endpoint': 'api.organizationmemberlist', 'request_id': 'urn:request:574044ba-556c-408f-8a8c-38a7322231f4', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/members', 'path': '/api/v1/organization/build_test/members', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,531 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,532 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/build_test/members HTTP/1.0" 200 387 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/build_test/members HTTP/1.1" 200 387 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1512 0.028)
gunicorn-web stdout | 2024-04-22 04:03:15,653 [282] [DEBUG] [app] Starting request: urn:request:f9940592-105f-4463-9d80-6ddca4b23c26 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:15,653 [278] [DEBUG] [app] Starting request: urn:request:233b480e-726d-4055-b0f7-4d83559b209f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:15,656 [292] [DEBUG] [app] Starting request: urn:request:b4f24d88-24a0-4c23-8c00-8a8d5e7f4ba6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:15,656 [289] [DEBUG] [app] Starting request: urn:request:706cd663-afc6-4e7f-9e33-0957f3df9218 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [292] [DEBUG] [app] Ending request: urn:request:b4f24d88-24a0-4c23-8c00-8a8d5e7f4ba6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b4f24d88-24a0-4c23-8c00-8a8d5e7f4ba6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [289] [DEBUG] [app] Ending request: urn:request:706cd663-afc6-4e7f-9e33-0957f3df9218 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:706cd663-afc6-4e7f-9e33-0957f3df9218', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:03:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:15,660 [278] [DEBUG] [app] Starting request: urn:request:e0f780ad-a166-4e0b-a3c6-24bbeea7e95f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:15,660 [278] [DEBUG] [app] Ending request: urn:request:e0f780ad-a166-4e0b-a3c6-24bbeea7e95f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e0f780ad-a166-4e0b-a3c6-24bbeea7e95f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,660 [281] [DEBUG] [app] Starting request: urn:request:d9f010c5-8f4a-4378-a428-3d283cd8751e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:15,660 [281] [DEBUG] [app] Ending request: urn:request:d9f010c5-8f4a-4378-a428-3d283cd8751e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d9f010c5-8f4a-4378-a428-3d283cd8751e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:03:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:15,674 [278] [DEBUG] [app] Ending request: urn:request:233b480e-726d-4055-b0f7-4d83559b209f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:233b480e-726d-4055-b0f7-4d83559b209f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:03:15,675 [282] [DEBUG] [app] Ending request: urn:request:f9940592-105f-4463-9d80-6ddca4b23c26 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f9940592-105f-4463-9d80-6ddca4b23c26', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:03:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [app] Starting request: urn:request:38ebb835-df49-4aa8-b9ca-45482b7bacb4 (/api/v1/organization/whuquay/members) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,701 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,701 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,701 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,705 [278] [DEBUG] [app] Ending request: urn:request:38ebb835-df49-4aa8-b9ca-45482b7bacb4 (/api/v1/organization/whuquay/members) {'endpoint': 'api.organizationmemberlist', 'request_id': 'urn:request:38ebb835-df49-4aa8-b9ca-45482b7bacb4', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/whuquay/members', 'path': '/api/v1/organization/whuquay/members', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,705 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,706 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/members HTTP/1.0" 404 244 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/members HTTP/1.1" 404 244 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1509 0.015)
gunicorn-web stdout | 2024-04-22 04:03:15,841 [278] [DEBUG] [app] Starting request: urn:request:fc965215-ea16-4b34-96e9-0c53373a2579 (/api/v1/organization/whuquay/robots) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,842 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,842 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,842 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,852 [278] [DEBUG] [peewee] ('SELECT "t1"."username", "t1"."creation_date", "t1"."last_accessed", "t2"."token", "t3"."description", "t3"."unstructured_json", "t4"."name", "t5"."name" FROM "user" AS "t1" LEFT OUTER JOIN "robotaccountmetadata" AS "t3" ON ("t3"."robot_account_id" = "t1"."id") INNER JOIN "robotaccounttoken" AS "t2" ON ("t2"."robot_account_id" = "t1"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."user_id" = "t2"."robot_account_id") LEFT OUTER JOIN "repository" AS "t4" ON ("t6"."repository_id" = "t4"."id") LEFT OUTER JOIN "teammember" AS "t7" ON ("t7"."user_id" = "t1"."id") LEFT OUTER JOIN "team" AS "t5" ON ("t7"."team_id" = "t5"."id") WHERE (("t1"."robot" = %s) AND ("t1"."username" ILIKE %s)) ORDER BY "t1"."last_accessed" DESC', [True, 'whuquay+%'])
gunicorn-web stdout | 2024-04-22 04:03:15,857 [278] [DEBUG] [app] Ending request: urn:request:fc965215-ea16-4b34-96e9-0c53373a2579 (/api/v1/organization/whuquay/robots) {'endpoint': 'api.orgrobotlist', 'request_id': 'urn:request:fc965215-ea16-4b34-96e9-0c53373a2579', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/whuquay/robots?permissions=true&token=false', 'path': '/api/v1/organization/whuquay/robots', 'parameters': {'permissions': 'true', 'token': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,857 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,858 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/robots?permissions=true&token=false HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/robots?permissions=true&token=false HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1537 0.017)
gunicorn-web stdout | 2024-04-22 04:03:16,022 [281] [DEBUG] [app] Starting request: urn:request:2852dcc6-8a54-42f7-9971-6c09b52965e0 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:16,022 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,022 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,023 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,035 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:16,038 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,041 [281] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'whuquay', 1, 3, 1, 'whuquay', 101])
gunicorn-web stdout | 2024-04-22 04:03:16,045 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:16,047 [281] [DEBUG] [app] Ending request: urn:request:2852dcc6-8a54-42f7-9971-6c09b52965e0 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:2852dcc6-8a54-42f7-9971-6c09b52965e0', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=whuquay&public=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'whuquay', 'public': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,048 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:16,048 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&public=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&public=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1540 0.027)
gunicorn-web stdout | 2024-04-22 04:03:16,209 [282] [DEBUG] [app] Starting request: urn:request:e5546e35-622a-4981-ac38-6e0a647146b9 (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:16,209 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,209 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,210 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,219 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,219 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,219 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,220 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,222 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,222 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,223 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,223 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,223 [278] [DEBUG] [app] Starting request: urn:request:58ea346b-534d-42cc-8955-55b4e5a74c30 (/api/v1/organization/build_test/robots) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:16,223 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,223 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,224 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,224 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:16,227 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:16,230 [281] [DEBUG] [app] Starting request: urn:request:d180a422-1cfb-48bf-89a5-4032c1210763 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:16,230 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:16,230 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,230 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,231 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,232 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,232 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,232 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,233 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,234 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:16,235 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,239 [278] [DEBUG] [peewee] ('SELECT "t1"."username", "t1"."creation_date", "t1"."last_accessed", "t2"."token", "t3"."description", "t3"."unstructured_json", "t4"."name", "t5"."name" FROM "user" AS "t1" LEFT OUTER JOIN "robotaccountmetadata" AS "t3" ON ("t3"."robot_account_id" = "t1"."id") INNER JOIN "robotaccounttoken" AS "t2" ON ("t2"."robot_account_id" = "t1"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."user_id" = "t2"."robot_account_id") LEFT OUTER JOIN "repository" AS "t4" ON ("t6"."repository_id" = "t4"."id") LEFT OUTER JOIN "teammember" AS "t7" ON ("t7"."user_id" = "t1"."id") LEFT OUTER JOIN "team" AS "t5" ON ("t7"."team_id" = "t5"."id") WHERE (("t1"."robot" = %s) AND ("t1"."username" ILIKE %s)) ORDER BY "t1"."last_accessed" DESC', [True, 'build_test+%'])
gunicorn-web stdout | 2024-04-22 04:03:16,239 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,240 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,241 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,242 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:16,243 [278] [DEBUG] [app] Ending request: urn:request:58ea346b-534d-42cc-8955-55b4e5a74c30 (/api/v1/organization/build_test/robots) {'endpoint': 'api.orgrobotlist', 'request_id': 'urn:request:58ea346b-534d-42cc-8955-55b4e5a74c30', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/robots?permissions=true&token=false', 'path': '/api/v1/organization/build_test/robots', 'parameters': {'permissions': 'true', 'token': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,243 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:16,243 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test/robots?permissions=true&token=false HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test/robots?permissions=true&token=false HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.021 1540 0.021)
gunicorn-web stdout | 2024-04-22 04:03:16,244 [281] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 1, 3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:16,245 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,248 [282] [DEBUG] [app] Ending request: urn:request:e5546e35-622a-4981-ac38-6e0a647146b9 (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:e5546e35-622a-4981-ac38-6e0a647146b9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,248 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:16,249 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:16,249 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1504 0.041)
gunicorn-web stdout | 2024-04-22 04:03:16,252 [281] [DEBUG] [app] Ending request: urn:request:d180a422-1cfb-48bf-89a5-4032c1210763 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:d180a422-1cfb-48bf-89a5-4032c1210763', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&public=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'public': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,252 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&public=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1543 0.024)
gunicorn-web stdout | 2024-04-22 04:03:16,253 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&public=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:02.556208+00:00 (in 46.003268 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:16 UTC)" (scheduled at 2024-04-22 04:03:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 16, 553328), True, datetime.datetime(2024, 4, 22, 4, 3, 16, 553328), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,563 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:03:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:03:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:47.052354+00:00 (in 29.999490 seconds)
buildlogsarchiver stdout | 2024-04-22 04:03:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:47 UTC)" (scheduled at 2024-04-22 04:03:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:03:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 3, 17, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:03:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:03:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:03:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:23.759375+00:00 (in 3.996653 seconds)
notificationworker stdout | 2024-04-22 04:03:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:08:19 UTC)" (scheduled at 2024-04-22 04:03:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:03:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 'notification/%'])
notificationworker stdout | 2024-04-22 04:03:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:19 UTC)" (scheduled at 2024-04-22 04:03:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:03:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:03:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), True, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:03:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), True, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 'notification/%'])
notificationworker stdout | 2024-04-22 04:03:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:08:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:03:19,966 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:03:21,436 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:03:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:03:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:43.057186+00:00 (in 20.997621 seconds)
namespacegcworker stdout | 2024-04-22 04:03:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:22 UTC)" (scheduled at 2024-04-22 04:03:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:03:22,060 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:03:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:33.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:03:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:33 UTC)" (scheduled at 2024-04-22 04:03:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 23, 760351), True, datetime.datetime(2024, 4, 22, 4, 3, 23, 760351), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:24.361582+00:00 (in 59.999448 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:24 UTC)" (scheduled at 2024-04-22 04:03:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:03:25,080 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:03:26,783 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:03:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:35.871852+00:00 (in 8.998222 seconds)
securityworker stdout | 2024-04-22 04:03:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:56 UTC)" (scheduled at 2024-04-22 04:03:26.873109+00:00)
securityworker stdout | 2024-04-22 04:03:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:03:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:03:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 58, 26, 881872), 1, 2])
securityworker stdout | 2024-04-22 04:03:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 58, 26, 881872), 1, 2])
securityworker stdout | 2024-04-22 04:03:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:03:28,166 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:03:30,038 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:03:30,041 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:03:30,044 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:03:30,046 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:03:30,048 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
teamsyncworker stdout | 2024-04-22 04:03:30,060 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:03:30,211 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:03:30,653 [282] [DEBUG] [app] Starting request: urn:request:c7596b8a-53f9-4e14-937c-792aaa959a87 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:30,653 [279] [DEBUG] [app] Starting request: urn:request:41e41ad0-dfd3-46eb-96d5-9f4abd45e1ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:30,656 [284] [DEBUG] [app] Starting request: urn:request:30fb3ce3-d400-44f5-ba1a-3e7d713ae454 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [292] [DEBUG] [app] Starting request: urn:request:c7304df0-9aed-483f-8842-9ab167d8ebc8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [284] [DEBUG] [app] Ending request: urn:request:30fb3ce3-d400-44f5-ba1a-3e7d713ae454 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:30fb3ce3-d400-44f5-ba1a-3e7d713ae454', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [292] [DEBUG] [app] Ending request: urn:request:c7304df0-9aed-483f-8842-9ab167d8ebc8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c7304df0-9aed-483f-8842-9ab167d8ebc8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:03:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:30,660 [278] [DEBUG] [app] Starting request: urn:request:22d357da-cead-4875-8951-d62028d834be (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:30,660 [278] [DEBUG] [app] Ending request: urn:request:22d357da-cead-4875-8951-d62028d834be (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:22d357da-cead-4875-8951-d62028d834be', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:30,661 [281] [DEBUG] [app] Starting request: urn:request:844a8c19-9067-42f6-9fe0-999e927d3e45 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:30,661 [281] [DEBUG] [app] Ending request: urn:request:844a8c19-9067-42f6-9fe0-999e927d3e45 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:844a8c19-9067-42f6-9fe0-999e927d3e45', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:30,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:30,675 [279] [DEBUG] [app] Ending request: urn:request:41e41ad0-dfd3-46eb-96d5-9f4abd45e1ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:41e41ad0-dfd3-46eb-96d5-9f4abd45e1ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:03:30,676 [282] [DEBUG] [app] Ending request: urn:request:c7596b8a-53f9-4e14-937c-792aaa959a87 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c7596b8a-53f9-4e14-937c-792aaa959a87', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:03:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 04:03:31,056 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:03:32,648 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:03:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:43.759375+00:00 (in 9.999495 seconds)
notificationworker stdout | 2024-04-22 04:03:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:43 UTC)" (scheduled at 2024-04-22 04:03:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 33, 760283), True, datetime.datetime(2024, 4, 22, 4, 3, 33, 760283), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:03:33,935 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:03:34,211 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:03:34,441 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:03:34,652 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:03:34,656 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:03:34,661 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:03:35,465 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:56.873109+00:00 (in 21.000762 seconds)
securityworker stdout | 2024-04-22 04:03:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:05 UTC)" (scheduled at 2024-04-22 04:03:35.871852+00:00)
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:03:36,644 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:03:36,763 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:03:36,898 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:03:37,882 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:03:39,212 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:03:39,248 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:41.564959+00:00 (in 1.997452 seconds)
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:39 UTC)" (scheduled at 2024-04-22 04:03:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:03:39,600 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:03:39,700 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:03:40,946 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:03:40,952 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
storagereplication stdout | 2024-04-22 04:03:40,955 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:03:40,957 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:03:40,961 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:03:40,964 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:03:40,966 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:03:40,969 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:03:40,973 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:03:40,975 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:03:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:03:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:11.264267+00:00 (in 29.999529 seconds)
autopruneworker stdout | 2024-04-22 04:03:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:11 UTC)" (scheduled at 2024-04-22 04:03:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:03:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758561271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:03:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:03:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:03:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:39.566970+00:00 (in 58.001497 seconds)
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:41 UTC)" (scheduled at 2024-04-22 04:03:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:03:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 41, 565740), True, datetime.datetime(2024, 4, 22, 4, 3, 41, 565740), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:03:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:03:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:03:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:03:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:03:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:22.058978+00:00 (in 39.001291 seconds)
namespacegcworker stdout | 2024-04-22 04:03:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:43 UTC)" (scheduled at 2024-04-22 04:03:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:03:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:03:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 43, 58093), True, datetime.datetime(2024, 4, 22, 4, 3, 43, 58093), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:03:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:03:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:03:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:53.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 04:03:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:53 UTC)" (scheduled at 2024-04-22 04:03:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 43, 760130), True, datetime.datetime(2024, 4, 22, 4, 3, 43, 760130), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:03:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:03:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:14.952062+00:00 (in 29.999471 seconds)
gcworker stdout | 2024-04-22 04:03:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:14 UTC)" (scheduled at 2024-04-22 04:03:44.952062+00:00)
gcworker stdout | 2024-04-22 04:03:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549024953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:03:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:03:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:03:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:45,653 [282] [DEBUG] [app] Starting request: urn:request:665874a9-3c62-4272-b4f8-54320357f45b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:45,653 [281] [DEBUG] [app] Starting request: urn:request:afc3353b-7ee7-41a8-a36a-5d348da8fffd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [292] [DEBUG] [app] Starting request: urn:request:a1411486-978d-448d-a98f-2d1271ff8765 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [284] [DEBUG] [app] Starting request: urn:request:58b56bcd-bcf8-42ff-a059-201e154f366b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [292] [DEBUG] [app] Ending request: urn:request:a1411486-978d-448d-a98f-2d1271ff8765 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1411486-978d-448d-a98f-2d1271ff8765', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [284] [DEBUG] [app] Ending request: urn:request:58b56bcd-bcf8-42ff-a059-201e154f366b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:58b56bcd-bcf8-42ff-a059-201e154f366b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:03:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:03:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:45,659 [282] [DEBUG] [app] Starting request: urn:request:535853f6-db09-4405-bc8a-e93415cacde1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:45,659 [282] [DEBUG] [app] Ending request: urn:request:535853f6-db09-4405-bc8a-e93415cacde1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:535853f6-db09-4405-bc8a-e93415cacde1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:45,660 [279] [DEBUG] [app] Starting request: urn:request:3672ece5-47f7-4b6e-9913-f7ea8de305b1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:45,660 [279] [DEBUG] [app] Ending request: urn:request:3672ece5-47f7-4b6e-9913-f7ea8de305b1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3672ece5-47f7-4b6e-9913-f7ea8de305b1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:03:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:45,674 [282] [DEBUG] [app] Ending request: urn:request:665874a9-3c62-4272-b4f8-54320357f45b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:665874a9-3c62-4272-b4f8-54320357f45b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:03:45,675 [281] [DEBUG] [app] Ending request: urn:request:afc3353b-7ee7-41a8-a36a-5d348da8fffd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:afc3353b-7ee7-41a8-a36a-5d348da8fffd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:03:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 04:03:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:03:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:17.052354+00:00 (in 29.999473 seconds)
buildlogsarchiver stdout | 2024-04-22 04:03:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:17 UTC)" (scheduled at 2024-04-22 04:03:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:03:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 3, 47, 53237), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:03:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:03:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:03:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:03:50,001 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:03:51,473 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:51 +0000] "GET /angular/?_=1713758630462 HTTP/1.1" 302 145 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1493 -)
gunicorn-web stdout | 2024-04-22 04:03:52,097 [278] [DEBUG] [app] Starting request: urn:request:35c17293-f79e-46b6-88e0-de4ea438d960 (/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:52,098 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,100 [278] [DEBUG] [app] Ending request: urn:request:35c17293-f79e-46b6-88e0-de4ea438d960 (/) {'endpoint': 'web.index', 'request_id': 'urn:request:35c17293-f79e-46b6-88e0-de4ea438d960', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462', 'path': '/', 'parameters': {'_': '1713758630462'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:52,101 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:52 +0000] "GET /?_=1713758630462 HTTP/1.0" 200 93195 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:52 +0000] "GET /?_=1713758630462 HTTP/1.1" 200 14252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.006 1468 0.005)
gunicorn-web stdout | 2024-04-22 04:03:52,691 [278] [DEBUG] [app] Starting request: urn:request:fa9040df-bba6-4bce-82f3-de3cd27b2bc7 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:52,691 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,691 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,692 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,701 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:52,701 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:52,701 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,703 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:52,706 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,706 [278] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:03:52,709 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:03:52,712 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,714 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:52,717 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,719 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:52,721 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,723 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,723 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,724 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,728 [278] [DEBUG] [app] Ending request: urn:request:fa9040df-bba6-4bce-82f3-de3cd27b2bc7 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:fa9040df-bba6-4bce-82f3-de3cd27b2bc7', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:52,728 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:52,728 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:52 +0000] "GET /api/v1/user/ HTTP/1.0" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:52 +0000] "GET /api/v1/user/ HTTP/1.1" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1473 0.039)
gunicorn-web stdout | 2024-04-22 04:03:53,050 [282] [DEBUG] [app] Starting request: urn:request:66053c96-3a95-4154-ad52-b5ea3ef01d06 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:53,050 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,050 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,051 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,059 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,059 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,059 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,061 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:03:53,066 [282] [DEBUG] [app] Ending request: urn:request:66053c96-3a95-4154-ad52-b5ea3ef01d06 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:66053c96-3a95-4154-ad52-b5ea3ef01d06', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,067 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,067 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.018 1486 0.018)
gunicorn-web stdout | 2024-04-22 04:03:53,376 [282] [DEBUG] [app] Starting request: urn:request:5e205730-8a84-46d5-be44-e114150a70e3 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:53,376 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,376 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,377 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,385 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,385 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,385 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,387 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:53,390 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:53,393 [282] [DEBUG] [app] Ending request: urn:request:5e205730-8a84-46d5-be44-e114150a70e3 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:5e205730-8a84-46d5-be44-e114150a70e3', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&popularity=true&starred=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'popularity': 'true', 'starred': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,393 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,393 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.018 1537 0.018)
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [app] Starting request: urn:request:801006ad-c206-46f7-967b-273f215ab492 (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,410 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,410 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,410 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,411 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:03:53,413 [279] [DEBUG] [app] Ending request: urn:request:801006ad-c206-46f7-967b-273f215ab492 (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:801006ad-c206-46f7-967b-273f215ab492', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,414 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,414 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1476 0.014)
gunicorn-web stdout | 2024-04-22 04:03:53,757 [278] [DEBUG] [app] Starting request: urn:request:7327aadc-99ea-4465-bb48-4316184586bd (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:53,757 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,757 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,758 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
notificationworker stdout | 2024-04-22 04:03:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:03.759375+00:00 (in 9.999498 seconds)
notificationworker stdout | 2024-04-22 04:03:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:03 UTC)" (scheduled at 2024-04-22 04:03:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 53, 760249), True, datetime.datetime(2024, 4, 22, 4, 3, 53, 760249), 0, 'notification/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,769 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 15, 53, 768912), datetime.datetime(2024, 4, 22, 4, 3, 53, 768971)])
gunicorn-web stdout | 2024-04-22 04:03:53,771 [278] [DEBUG] [app] Ending request: urn:request:7327aadc-99ea-4465-bb48-4316184586bd (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:7327aadc-99ea-4465-bb48-4316184586bd', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,772 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,772 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1495 0.016)
notificationworker stdout | 2024-04-22 04:03:53,774 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:53,774 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:53,775 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:54,031 [281] [DEBUG] [app] Starting request: urn:request:303200e3-bcfa-4dcc-ab03-3e909387dcff (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:54,031 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,031 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,032 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,034 [278] [DEBUG] [app] Starting request: urn:request:d4c7bceb-5d3b-43b4-b883-c8bb9aa6176d (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:54,034 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,034 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,035 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:54,042 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,043 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:54,043 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:54,043 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:54,045 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,045 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE ((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) ORDER BY rid LIMIT %s', [3, 1, 'whuquay', 101])
gunicorn-web stdout | 2024-04-22 04:03:54,047 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:54,049 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:54,049 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE ((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:54,052 [281] [DEBUG] [app] Ending request: urn:request:303200e3-bcfa-4dcc-ab03-3e909387dcff (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:303200e3-bcfa-4dcc-ab03-3e909387dcff', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'whuquay', 'popularity': 'true', 'quota': 'true', 'state': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:54,052 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1564 0.022)
gunicorn-web stdout | 2024-04-22 04:03:54,052 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:54,053 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:54,056 [278] [DEBUG] [app] Ending request: urn:request:d4c7bceb-5d3b-43b4-b883-c8bb9aa6176d (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:d4c7bceb-5d3b-43b4-b883-c8bb9aa6176d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=false&quota=true&state=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'popularity': 'true', 'public': 'false', 'quota': 'true', 'state': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:54,057 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:54,057 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=false&quota=true&state=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=false&quota=true&state=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1580 0.024)
builder stdout | 2024-04-22 04:03:55,116 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:03:56,814 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:03:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:05.871852+00:00 (in 8.998246 seconds)
securityworker stdout | 2024-04-22 04:03:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:26 UTC)" (scheduled at 2024-04-22 04:03:56.873109+00:00)
securityworker stdout | 2024-04-22 04:03:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:03:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:03:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 58, 56, 881070), 1, 2])
securityworker stdout | 2024-04-22 04:03:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 58, 56, 881070), 1, 2])
securityworker stdout | 2024-04-22 04:03:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:03:58,192 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:03:58,578 [278] [DEBUG] [app] Starting request: urn:request:1a8d8fb1-3cba-4712-95d0-fc81eda3570e (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:58,579 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,579 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,579 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,588 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:58,588 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:58,588 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,589 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,592 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:58,598 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:58,601 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:58,603 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:58,608 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,610 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:58,612 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,614 [278] [DEBUG] [app] Ending request: urn:request:1a8d8fb1-3cba-4712-95d0-fc81eda3570e (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:1a8d8fb1-3cba-4712-95d0-fc81eda3570e', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:58,615 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:58,615 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:58 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:58 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1498 0.038)
gunicorn-web stdout | 2024-04-22 04:03:58,995 [282] [DEBUG] [app] Starting request: urn:request:d13c9040-ed56-4737-b0cc-9ac10016a5aa (/api/v1/organization/build_test/quota) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:58,995 [278] [DEBUG] [app] Starting request: urn:request:38dc469c-acbf-4936-95fe-ac3f244d2008 (/api/v1/organization/build_test/proxycache) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:58,995 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,996 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,005 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,007 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:59,007 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,010 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,011 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,011 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,013 [278] [DEBUG] [app] Ending request: urn:request:38dc469c-acbf-4936-95fe-ac3f244d2008 (/api/v1/organization/build_test/proxycache) {'endpoint': 'api.organizationproxycacheconfig', 'request_id': 'urn:request:38dc469c-acbf-4936-95fe-ac3f244d2008', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/proxycache', 'path': '/api/v1/organization/build_test/proxycache', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,013 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:59,013 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.1" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.020 1509 0.020)
gunicorn-web stdout | 2024-04-22 04:03:59,014 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.0" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:59,016 [282] [DEBUG] [app] Ending request: urn:request:d13c9040-ed56-4737-b0cc-9ac10016a5aa (/api/v1/organization/build_test/quota) {'endpoint': 'api.organizationquotalist', 'request_id': 'urn:request:d13c9040-ed56-4737-b0cc-9ac10016a5aa', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/quota', 'path': '/api/v1/organization/build_test/quota', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,016 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:59,016 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.0" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.1" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1504 0.022)
gunicorn-web stdout | 2024-04-22 04:03:59,036 [282] [DEBUG] [app] Starting request: urn:request:5563121c-b61a-4dde-8ada-a283cd6e403c (/api/v1/organization/build_test/prototypes) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:59,036 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,037 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,037 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [app] Starting request: urn:request:4d0c4490-cb79-4c4f-9558-86a15c70e487 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,048 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,052 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,053 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,054 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" LEFT OUTER JOIN "user" AS "t2" ON ("t2"."id" = "t1"."activating_user_id") LEFT OUTER JOIN "user" AS "t3" ON ("t3"."id" = "t1"."delegate_user_id") LEFT OUTER JOIN "team" AS "t4" ON ("t4"."id" = "t1"."delegate_team_id") LEFT OUTER JOIN "role" AS "t5" ON ("t5"."id" = "t1"."role_id") WHERE ("t1"."org_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:59,055 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,057 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,057 [282] [DEBUG] [app] Ending request: urn:request:5563121c-b61a-4dde-8ada-a283cd6e403c (/api/v1/organization/build_test/prototypes) {'endpoint': 'api.permissionprototypelist', 'request_id': 'urn:request:5563121c-b61a-4dde-8ada-a283cd6e403c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/prototypes', 'path': '/api/v1/organization/build_test/prototypes', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,058 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.1" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1509 0.022)
gunicorn-web stdout | 2024-04-22 04:03:59,058 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.0" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:59,060 [278] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 1, 3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:59,064 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:59,067 [278] [DEBUG] [app] Ending request: urn:request:4d0c4490-cb79-4c4f-9558-86a15c70e487 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:4d0c4490-cb79-4c4f-9558-86a15c70e487', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'popularity': 'true', 'public': 'true', 'quota': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,067 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1564 0.024)
gunicorn-web stdout | 2024-04-22 04:03:59,068 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:00,047 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:04:00,051 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:04:00,054 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:04:00,056 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:04:00,059 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
teamsyncworker stdout | 2024-04-22 04:04:00,067 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:04:00,241 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:04:00,653 [278] [DEBUG] [app] Starting request: urn:request:738e2792-3238-42c0-9d4d-6e76942d67a6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:00,653 [279] [DEBUG] [app] Starting request: urn:request:b2f66a13-2a8e-4b2f-b8b4-d75afc3297e5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [292] [DEBUG] [app] Starting request: urn:request:2e6d9e4a-50f4-44bc-ae2c-c58cd3eb5a6c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [284] [DEBUG] [app] Starting request: urn:request:1a948eb4-26d4-4a08-a1ef-6bf2db2a1983 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [284] [DEBUG] [app] Ending request: urn:request:1a948eb4-26d4-4a08-a1ef-6bf2db2a1983 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1a948eb4-26d4-4a08-a1ef-6bf2db2a1983', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [292] [DEBUG] [app] Ending request: urn:request:2e6d9e4a-50f4-44bc-ae2c-c58cd3eb5a6c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2e6d9e4a-50f4-44bc-ae2c-c58cd3eb5a6c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:04:00,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:04:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:00,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:00,661 [279] [DEBUG] [app] Starting request: urn:request:2078b93b-2017-4b06-8fed-c97009875ef5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:00,661 [282] [DEBUG] [app] Starting request: urn:request:6d687cbe-443a-4a86-9d50-ea08e3fdd447 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:00,661 [279] [DEBUG] [app] Ending request: urn:request:2078b93b-2017-4b06-8fed-c97009875ef5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2078b93b-2017-4b06-8fed-c97009875ef5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:00,661 [282] [DEBUG] [app] Ending request: urn:request:6d687cbe-443a-4a86-9d50-ea08e3fdd447 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6d687cbe-443a-4a86-9d50-ea08e3fdd447', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:04:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:00,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:00,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:00,676 [278] [DEBUG] [app] Ending request: urn:request:738e2792-3238-42c0-9d4d-6e76942d67a6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:738e2792-3238-42c0-9d4d-6e76942d67a6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 04:04:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:04:00,677 [279] [DEBUG] [app] Ending request: urn:request:b2f66a13-2a8e-4b2f-b8b4-d75afc3297e5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b2f66a13-2a8e-4b2f-b8b4-d75afc3297e5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:00,677 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 04:04:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /static/fonts/glyphicons-halflings-regular.woff2 HTTP/1.1" 200 18028 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/static/ldn/bootstrap.min.css-13f668494557.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1446 -)
quotatotalworker stdout | 2024-04-22 04:04:01,052 [83] [DEBUG] [workers.worker] Scheduling worker.
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [INFO] [apscheduler.scheduler] Scheduler started
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 04:04:16.054492
quotatotalworker stdout | 2024-04-22 04:04:01,054 [83] [INFO] [apscheduler.scheduler] Added job "QuotaTotalWorker.backfill" to job store "default"
quotatotalworker stdout | 2024-04-22 04:04:01,055 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:16.054492+00:00 (in 14.999412 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:04:01,070 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:16.552337+00:00 (in 13.995602 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:02 UTC)" (scheduled at 2024-04-22 04:04:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:02,684 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:04:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:13.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:04:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:13 UTC)" (scheduled at 2024-04-22 04:04:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 3, 760261), True, datetime.datetime(2024, 4, 22, 4, 4, 3, 760261), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:04:03,971 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:04:04,243 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:04:04,454 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:04:04,662 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:04:04,664 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:04:04,668 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:04:05,500 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:26.873109+00:00 (in 21.000826 seconds)
securityworker stdout | 2024-04-22 04:04:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:35 UTC)" (scheduled at 2024-04-22 04:04:05.871852+00:00)
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:04:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:04:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:13.555667+00:00 (in 7.002653 seconds)
repositorygcworker stdout | 2024-04-22 04:04:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:06 UTC)" (scheduled at 2024-04-22 04:04:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:04:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:04:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 6, 553425), True, datetime.datetime(2024, 4, 22, 4, 4, 6, 553425), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:04:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:04:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:04:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:04:06,682 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:04:06,799 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:04:06,934 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:04:07,919 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:04:09,250 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:04:09,284 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:04:09,622 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:04:09,706 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:04:10,958 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:04:10,964 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:04:10,968 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:04:10,970 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:04:10,974 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:04:10,978 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:04:10,981 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:04:10,984 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:04:10,986 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:04:10,989 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:04:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:04:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:41.264267+00:00 (in 29.999439 seconds)
autopruneworker stdout | 2024-04-22 04:04:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:41 UTC)" (scheduled at 2024-04-22 04:04:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:04:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758591271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:04:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:04:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:04:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:12,180 [278] [DEBUG] [app] Starting request: urn:request:36128063-fa31-4c51-804f-7c59cfbea809 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:12,180 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,180 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,181 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,190 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,190 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:12,190 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,193 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:04:12,197 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,200 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,203 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,205 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:04:12,207 [278] [DEBUG] [peewee] ('INSERT INTO "repository" ("namespace_user_id", "name", "visibility_id", "description", "badge_token", "kind_id", "trust_enabled", "state") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repository"."id"', [2, 'pushno', 2, '', '4e9e236d-00da-4775-9f4b-1d801cd061e3', 1, False, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,209 [278] [DEBUG] [peewee] ('INSERT INTO "repositoryactioncount" ("repository_id", "count", "date") VALUES (%s, %s, %s) RETURNING "repositoryactioncount"."id"', [1, 0, datetime.date(2024, 4, 21)])
gunicorn-web stdout | 2024-04-22 04:04:12,211 [278] [DEBUG] [peewee] ('INSERT INTO "repositorysearchscore" ("repository_id", "score") VALUES (%s, %s) RETURNING "repositorysearchscore"."id"', [1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,213 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "role" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['admin', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,214 [278] [DEBUG] [peewee] ('INSERT INTO "repositorypermission" ("user_id", "repository_id", "role_id") VALUES (%s, %s, %s) RETURNING "repositorypermission"."id"', [1, 1, 1])
gunicorn-web stdout | 2024-04-22 04:04:12,219 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" WHERE ((("t1"."org_id" = %s) AND (("t1"."activating_user_id" = %s) OR ("t1"."activating_user_id" IS %s))) AND ("t1"."delegate_user_id" IS %s))', [2, 1, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,221 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" WHERE ((("t1"."org_id" = %s) AND (("t1"."activating_user_id" = %s) OR ("t1"."activating_user_id" IS %s))) AND ("t1"."delegate_team_id" IS %s))', [2, 1, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,223 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,226 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,228 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:04:12,232 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [14, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 4, 12, 226162), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test"}'])
gunicorn-web stdout | 2024-04-22 04:04:12,236 [278] [DEBUG] [app] Ending request: urn:request:36128063-fa31-4c51-804f-7c59cfbea809 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:36128063-fa31-4c51-804f-7c59cfbea809', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository', 'path': '/api/v1/repository', 'parameters': {}, 'json_body': {'namespace': 'build_test', 'repository': 'pushno', 'visibility': 'private', 'description': '', 'repo_kind': 'image'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:12,236 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:12,237 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:12 +0000] "POST /api/v1/repository HTTP/1.0" 201 63 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/new/?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:12 +0000] "POST /api/v1/repository HTTP/1.1" 201 63 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/new/?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.059 1764 0.059)
gunicorn-web stdout | 2024-04-22 04:04:12,588 [281] [DEBUG] [app] Starting request: urn:request:56e09408-3f5b-4f08-a516-111d180bc95f (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:12,588 [282] [DEBUG] [app] Starting request: urn:request:667e76be-002b-4511-823b-764b3d47fad7 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:12,589 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,589 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,598 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,598 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,598 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:12,598 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,601 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:12,601 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:12,608 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,608 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,608 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:12,609 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,609 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,611 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,613 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,614 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:12,615 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,616 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,616 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,617 [282] [DEBUG] [app] Ending request: urn:request:667e76be-002b-4511-823b-764b3d47fad7 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:667e76be-002b-4511-823b-764b3d47fad7', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:12,617 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,617 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:12,618 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1565 0.037)
gunicorn-web stdout | 2024-04-22 04:04:12,620 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758652619, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,623 [281] [DEBUG] [app] Ending request: urn:request:56e09408-3f5b-4f08-a516-111d180bc95f (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:56e09408-3f5b-4f08-a516-111d180bc95f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:12,624 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:12,624 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.043 1571 0.043)
gunicorn-web stdout | 2024-04-22 04:04:13,122 [282] [DEBUG] [app] Starting request: urn:request:172daefd-9e35-4782-8c12-210505f0a442 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:13,122 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,122 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,123 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,133 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,133 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,133 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,135 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:13,141 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,142 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:13,147 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:04:13,153 [282] [DEBUG] [app] Ending request: urn:request:172daefd-9e35-4782-8c12-210505f0a442 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:172daefd-9e35-4782-8c12-210505f0a442', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:13,154 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:13,154 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:13 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:13 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1544 0.033)
repositorygcworker stdout | 2024-04-22 04:04:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:06.552482+00:00 (in 52.996357 seconds)
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:13 UTC)" (scheduled at 2024-04-22 04:04:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:19.762424+00:00 (in 6.002529 seconds)
notificationworker stdout | 2024-04-22 04:04:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:23 UTC)" (scheduled at 2024-04-22 04:04:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 13, 760284), True, datetime.datetime(2024, 4, 22, 4, 4, 13, 760284), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:13,773 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:13,773 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:13,773 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:14,857 [278] [DEBUG] [app] Starting request: urn:request:2e2ccd43-4683-4705-b725-d9d8c00b69e3 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:14,857 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,857 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,858 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,861 [281] [DEBUG] [app] Starting request: urn:request:80ade038-6163-409c-9c67-872865e84abb (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:14,861 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,861 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,862 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,868 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,868 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,868 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,870 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:14,870 [279] [DEBUG] [app] Starting request: urn:request:161ed142-ecc9-46d2-a586-435698e56520 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:04:14,870 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,870 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,871 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,871 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:14,871 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:14,871 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,875 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:14,877 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,877 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,879 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:14,879 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:14,879 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,880 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:14,881 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,882 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:14,882 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:14,883 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:04:14,885 [281] [DEBUG] [app] Ending request: urn:request:80ade038-6163-409c-9c67-872865e84abb (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:80ade038-6163-409c-9c67-872865e84abb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:14,885 [278] [DEBUG] [app] Ending request: urn:request:2e2ccd43-4683-4705-b725-d9d8c00b69e3 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:2e2ccd43-4683-4705-b725-d9d8c00b69e3', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:14,885 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:14,886 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:14,886 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:14,886 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1558 0.026)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1558 0.032)
gunicorn-web stdout | 2024-04-22 04:04:14,889 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,890 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,893 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:14,896 [279] [DEBUG] [app] Ending request: urn:request:161ed142-ecc9-46d2-a586-435698e56520 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:161ed142-ecc9-46d2-a586-435698e56520', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:14,897 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 22 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1554 0.032)
gunicorn-web stdout | 2024-04-22 04:04:14,897 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 22 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gcworker stdout | 2024-04-22 04:04:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:04:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:44.952062+00:00 (in 29.999515 seconds)
gcworker stdout | 2024-04-22 04:04:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:44 UTC)" (scheduled at 2024-04-22 04:04:14.952062+00:00)
gcworker stdout | 2024-04-22 04:04:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549054952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:04:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:04:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:04:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:15,653 [278] [DEBUG] [app] Starting request: urn:request:433b5a35-2d59-4bfb-8506-59ccf496cd87 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:15,653 [279] [DEBUG] [app] Starting request: urn:request:7cc4bd79-296e-4795-b970-cf74ef976f9a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [284] [DEBUG] [app] Starting request: urn:request:5c0bcac1-9a1d-4b52-a802-cd6e05109056 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [292] [DEBUG] [app] Starting request: urn:request:36eaa315-a5d6-4657-a33f-45ec6348398f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [284] [DEBUG] [app] Ending request: urn:request:5c0bcac1-9a1d-4b52-a802-cd6e05109056 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c0bcac1-9a1d-4b52-a802-cd6e05109056', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [292] [DEBUG] [app] Ending request: urn:request:36eaa315-a5d6-4657-a33f-45ec6348398f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:36eaa315-a5d6-4657-a33f-45ec6348398f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:04:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:04:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:15,659 [282] [DEBUG] [app] Starting request: urn:request:1e41ee86-f2bc-4724-a9f3-4516cd426033 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [281] [DEBUG] [app] Starting request: urn:request:9a36d537-add0-47c0-82db-13c3afb76cbf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [282] [DEBUG] [app] Ending request: urn:request:1e41ee86-f2bc-4724-a9f3-4516cd426033 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1e41ee86-f2bc-4724-a9f3-4516cd426033', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [281] [DEBUG] [app] Ending request: urn:request:9a36d537-add0-47c0-82db-13c3afb76cbf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a36d537-add0-47c0-82db-13c3afb76cbf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:15,674 [278] [DEBUG] [app] Ending request: urn:request:433b5a35-2d59-4bfb-8506-59ccf496cd87 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:433b5a35-2d59-4bfb-8506-59ccf496cd87', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:04:15,675 [279] [DEBUG] [app] Ending request: urn:request:7cc4bd79-296e-4795-b970-cf74ef976f9a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7cc4bd79-296e-4795-b970-cf74ef976f9a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
quotatotalworker stdout | 2024-04-22 04:04:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:16 UTC)" (scheduled at 2024-04-22 04:04:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:04:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:04:16,057 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:31.054492+00:00 (in 14.997229 seconds)
quotatotalworker stdout | 2024-04-22 04:04:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:04:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:31 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:16,397 [281] [DEBUG] [app] Starting request: urn:request:b53a6379-64cb-4cdd-87a9-09d47da9e6e5 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:16,397 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,397 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,398 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:16,407 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,411 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:16,418 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,418 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:16,419 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:16,422 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:16,424 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:16,426 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,427 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,427 [281] [DEBUG] [app] Ending request: urn:request:b53a6379-64cb-4cdd-87a9-09d47da9e6e5 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:b53a6379-64cb-4cdd-87a9-09d47da9e6e5', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:16,428 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:16 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1565 0.033)
gunicorn-web stdout | 2024-04-22 04:04:16,428 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:16 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:02.556208+00:00 (in 46.003323 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:16 UTC)" (scheduled at 2024-04-22 04:04:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 16, 553292), True, datetime.datetime(2024, 4, 22, 4, 4, 16, 553292), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,563 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,563 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,563 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:04:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:04:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:47.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 04:04:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:47 UTC)" (scheduled at 2024-04-22 04:04:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:04:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 4, 17, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:04:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:04:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:04:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:23.759375+00:00 (in 3.996479 seconds)
notificationworker stdout | 2024-04-22 04:04:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:19 UTC)" (scheduled at 2024-04-22 04:04:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:04:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:04:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:04:20,028 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:04:20 +0000] "GET /static/img/flowdock.ico HTTP/1.1" 200 5558 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1384 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:21 +0000] "GET /static/img/hipchat.png HTTP/1.1" 200 2825 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1364 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:21 +0000] "GET /static/img/slack.ico HTTP/1.1" 200 22486 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1362 -)
securityscanningnotificationworker stdout | 2024-04-22 04:04:21,510 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:43.057186+00:00 (in 20.997719 seconds)
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:22 UTC)" (scheduled at 2024-04-22 04:04:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:33.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:04:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:33 UTC)" (scheduled at 2024-04-22 04:04:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 23, 760258), True, datetime.datetime(2024, 4, 22, 4, 4, 23, 760258), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:24.361582+00:00 (in 59.999451 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:24 UTC)" (scheduled at 2024-04-22 04:04:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:24 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:25,066 [278] [DEBUG] [app] Starting request: urn:request:2023af4c-3376-4446-9921-ee18fe2cdd52 (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:25,066 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,066 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,067 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,078 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,078 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,078 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,079 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,080 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:04:25,083 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:04:25,086 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:04:25,089 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:04:25,090 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,090 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,091 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,091 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:04:25,093 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,095 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:04:25,097 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,100 [278] [DEBUG] [app] Ending request: urn:request:2023af4c-3376-4446-9921-ee18fe2cdd52 (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:2023af4c-3376-4446-9921-ee18fe2cdd52', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:25,100 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:25,101 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:25 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:25 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1523 0.037)
builder stdout | 2024-04-22 04:04:25,127 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:04:26,850 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:04:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:35.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:04:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:56 UTC)" (scheduled at 2024-04-22 04:04:26.873109+00:00)
securityworker stdout | 2024-04-22 04:04:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:04:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:04:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 59, 26, 881316), 1, 2])
securityworker stdout | 2024-04-22 04:04:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 59, 26, 881316), 1, 2])
securityworker stdout | 2024-04-22 04:04:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:56 UTC)" executed successfully
quotatotalworker stdout | 2024-04-22 04:04:28,093 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:04:28,212 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:04:30,056 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:04:30,063 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:04:30,065 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:04:30,068 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:04:30,071 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:04:30,103 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:04:30,257 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:04:30,653 [281] [DEBUG] [app] Starting request: urn:request:a1c86e28-b47a-4862-8503-7ca9d2b42910 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:30,653 [282] [DEBUG] [app] Starting request: urn:request:82d886d4-91fa-480d-b5a8-29b37854565c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:30,656 [292] [DEBUG] [app] Starting request: urn:request:204c4650-b488-400d-bebf-c203ba316ea9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [284] [DEBUG] [app] Starting request: urn:request:ac44b5fa-ba88-49f1-9bef-d99ac34d9c14 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [292] [DEBUG] [app] Ending request: urn:request:204c4650-b488-400d-bebf-c203ba316ea9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:204c4650-b488-400d-bebf-c203ba316ea9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [284] [DEBUG] [app] Ending request: urn:request:ac44b5fa-ba88-49f1-9bef-d99ac34d9c14 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ac44b5fa-ba88-49f1-9bef-d99ac34d9c14', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:04:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:30,660 [278] [DEBUG] [app] Starting request: urn:request:521d36ad-38bd-49ac-9bdd-770cb1172f88 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:30,660 [278] [DEBUG] [app] Ending request: urn:request:521d36ad-38bd-49ac-9bdd-770cb1172f88 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:521d36ad-38bd-49ac-9bdd-770cb1172f88', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:30,660 [281] [DEBUG] [app] Starting request: urn:request:187a35ef-fa7c-4bc3-9b5c-506580bb4a88 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:04:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:30,661 [281] [DEBUG] [app] Ending request: urn:request:187a35ef-fa7c-4bc3-9b5c-506580bb4a88 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:187a35ef-fa7c-4bc3-9b5c-506580bb4a88', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:30,676 [282] [DEBUG] [app] Ending request: urn:request:82d886d4-91fa-480d-b5a8-29b37854565c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:82d886d4-91fa-480d-b5a8-29b37854565c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
gunicorn-web stdout | 2024-04-22 04:04:30,676 [281] [DEBUG] [app] Ending request: urn:request:a1c86e28-b47a-4862-8503-7ca9d2b42910 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1c86e28-b47a-4862-8503-7ca9d2b42910', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:04:31,055 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:46.054492+00:00 (in 14.999019 seconds)
quotatotalworker stdout | 2024-04-22 04:04:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:46 UTC)" (scheduled at 2024-04-22 04:04:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:04:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:04:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:04:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:04:31,100 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:04:32,696 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:04:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:43.759375+00:00 (in 9.999505 seconds)
notificationworker stdout | 2024-04-22 04:04:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:43 UTC)" (scheduled at 2024-04-22 04:04:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 33, 760272), True, datetime.datetime(2024, 4, 22, 4, 4, 33, 760272), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:04:34,005 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:04:34,280 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:04:34,491 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:04:34,669 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:04:34,673 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:04:34,675 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:04:35,527 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:04:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:56.873109+00:00 (in 21.000738 seconds)
securityworker stdout | 2024-04-22 04:04:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:05 UTC)" (scheduled at 2024-04-22 04:04:35.871852+00:00)
securityworker stdout | 2024-04-22 04:04:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:04:36,718 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:04:36,832 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:04:36,949 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:04:37,950 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:04:39,262 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:04:39,320 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:41.564959+00:00 (in 1.997434 seconds)
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:39 UTC)" (scheduled at 2024-04-22 04:04:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:04:39,632 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:04:39,743 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:04:40,970 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:04:40,974 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:04:40,978 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:04:40,982 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:04:40,985 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:04:40,989 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:04:40,992 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:04:40,994 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:04:40,997 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:04:41,009 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-web stdout | 2024-04-22 04:04:41,097 [281] [DEBUG] [app] Starting request: urn:request:d6bb8c22-72eb-4a5d-b4e2-4c25ec8d584d (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,097 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,097 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,098 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,107 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,110 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,116 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,117 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,121 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,124 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,126 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,129 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['quay_notification', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,131 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['be8728b1-b88c-4c96-82bc-47b149e585ad', 1, 5, 4, 'push quay', '{"target": {"name": "owners", "kind": "team", "is_robot": false, "avatar": {"name": "owners", "hash": "6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90", "color": "#c7c7c7", "kind": "team"}, "is_org_member": true}}', '{}', 0])
gunicorn-web stdout | 2024-04-22 04:04:41,137 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,139 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,142 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 4, 41, 139534), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "be8728b1-b88c-4c96-82bc-47b149e585ad", "event": "repo_push", "method": "quay_notification"}'])
gunicorn-web stdout | 2024-04-22 04:04:41,146 [281] [DEBUG] [app] Ending request: urn:request:d6bb8c22-72eb-4a5d-b4e2-4c25ec8d584d (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:d6bb8c22-72eb-4a5d-b4e2-4c25ec8d584d', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'quay_notification', 'config': {'target': {'name': 'owners', 'kind': 'team', 'is_robot': False, 'avatar': {'name': 'owners', 'hash': '6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90', 'color': '#c7c7c7', 'kind': 'team'}, 'is_org_member': True}}, 'eventConfig': {}, 'title': 'push quay'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,146 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:41,147 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 411 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 411 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.051 2021 0.051)
autopruneworker stdout | 2024-04-22 04:04:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:04:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:11.264267+00:00 (in 29.999568 seconds)
autopruneworker stdout | 2024-04-22 04:04:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:11 UTC)" (scheduled at 2024-04-22 04:04:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:04:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758621271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:04:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:04:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:04:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:11 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [app] Starting request: urn:request:21411abf-dcb7-436a-bb17-f0d564808f11 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,488 [278] [DEBUG] [app] Starting request: urn:request:9e711a68-1978-432a-b716-db9e054b3e30 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,489 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,489 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,490 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,496 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,498 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,498 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,498 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,501 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,502 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,502 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,503 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,506 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,508 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,508 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:41,509 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,510 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,510 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,511 [281] [DEBUG] [app] Ending request: urn:request:21411abf-dcb7-436a-bb17-f0d564808f11 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:21411abf-dcb7-436a-bb17-f0d564808f11', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,511 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:41,511 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1557 0.027)
gunicorn-web stdout | 2024-04-22 04:04:41,513 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,516 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,518 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,521 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758681520, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,524 [278] [DEBUG] [app] Ending request: urn:request:9e711a68-1978-432a-b716-db9e054b3e30 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:9e711a68-1978-432a-b716-db9e054b3e30', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,524 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.044 1563 0.044)
gunicorn-web stdout | 2024-04-22 04:04:41,525 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:39.566970+00:00 (in 58.001546 seconds)
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:41 UTC)" (scheduled at 2024-04-22 04:04:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:04:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 41, 565643), True, datetime.datetime(2024, 4, 22, 4, 4, 41, 565643), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:04:41,575 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:04:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:04:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:41,918 [281] [DEBUG] [app] Starting request: urn:request:db320a37-94a9-432e-afff-e31c05d18552 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,918 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,918 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,919 [278] [DEBUG] [app] Starting request: urn:request:1a58f341-e10e-4eeb-9daa-8e6136bf2289 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,919 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,919 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,919 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,920 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,929 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,929 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,931 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,933 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,937 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,938 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:41,939 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,940 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,940 [281] [DEBUG] [app] Ending request: urn:request:db320a37-94a9-432e-afff-e31c05d18552 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:db320a37-94a9-432e-afff-e31c05d18552', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,941 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:04:41,941 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:41,943 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:41,946 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:04:41,948 [278] [DEBUG] [app] Ending request: urn:request:1a58f341-e10e-4eeb-9daa-8e6136bf2289 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:1a58f341-e10e-4eeb-9daa-8e6136bf2289', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,949 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1539 0.032)
gunicorn-web stdout | 2024-04-22 04:04:41,949 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [app] Starting request: urn:request:00d36c23-aa88-4331-aaf4-45276ed3ad6a (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,671 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,672 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:42,678 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,679 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,683 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:42,685 [278] [DEBUG] [app] Starting request: urn:request:549f2cca-2b10-4b5f-80e6-14afc183051f (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:42,685 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,685 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,685 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,686 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,687 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,690 [281] [DEBUG] [app] Ending request: urn:request:00d36c23-aa88-4331-aaf4-45276ed3ad6a (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:00d36c23-aa88-4331-aaf4-45276ed3ad6a', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:42,690 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1535 0.030)
gunicorn-web stdout | 2024-04-22 04:04:42,690 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,699 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:42,705 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,707 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,711 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:04:42,716 [278] [DEBUG] [app] Ending request: urn:request:549f2cca-2b10-4b5f-80e6-14afc183051f (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:549f2cca-2b10-4b5f-80e6-14afc183051f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:42,716 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1536 0.033)
gunicorn-web stdout | 2024-04-22 04:04:42,717 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
namespacegcworker stdout | 2024-04-22 04:04:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:04:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:22.058978+00:00 (in 39.001298 seconds)
namespacegcworker stdout | 2024-04-22 04:04:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:43 UTC)" (scheduled at 2024-04-22 04:04:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:04:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:04:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 43, 58095), True, datetime.datetime(2024, 4, 22, 4, 4, 43, 58095), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:04:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:04:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:04:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:53.759375+00:00 (in 9.999541 seconds)
notificationworker stdout | 2024-04-22 04:04:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:53 UTC)" (scheduled at 2024-04-22 04:04:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 43, 760093), True, datetime.datetime(2024, 4, 22, 4, 4, 43, 760093), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:04:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:04:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:14.952062+00:00 (in 29.999466 seconds)
gcworker stdout | 2024-04-22 04:04:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:14 UTC)" (scheduled at 2024-04-22 04:04:44.952062+00:00)
gcworker stdout | 2024-04-22 04:04:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549084953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:04:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:04:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:04:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:45,653 [278] [DEBUG] [app] Starting request: urn:request:4e7db7ff-f8bb-48e3-ab4d-c42723e5f592 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:45,653 [281] [DEBUG] [app] Starting request: urn:request:07945846-fed6-484a-9808-d0a032538ce4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:45,656 [289] [DEBUG] [app] Starting request: urn:request:050e3eb0-1481-4f96-8392-f8a52b344cb9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:45,656 [290] [DEBUG] [app] Starting request: urn:request:8a6e5cf9-9060-43ff-a2d5-cff6e1421489 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [290] [DEBUG] [app] Ending request: urn:request:8a6e5cf9-9060-43ff-a2d5-cff6e1421489 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8a6e5cf9-9060-43ff-a2d5-cff6e1421489', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [289] [DEBUG] [app] Ending request: urn:request:050e3eb0-1481-4f96-8392-f8a52b344cb9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:050e3eb0-1481-4f96-8392-f8a52b344cb9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:04:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [DEBUG] [app] Starting request: urn:request:98ecf3cc-476f-474f-adbd-244b4bb1a477 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [DEBUG] [app] Ending request: urn:request:98ecf3cc-476f-474f-adbd-244b4bb1a477 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:98ecf3cc-476f-474f-adbd-244b4bb1a477', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,661 [279] [DEBUG] [app] Starting request: urn:request:b3f77e97-e3bd-444a-b5da-48fb2ef4a4fb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:45,661 [279] [DEBUG] [app] Ending request: urn:request:b3f77e97-e3bd-444a-b5da-48fb2ef4a4fb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b3f77e97-e3bd-444a-b5da-48fb2ef4a4fb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:45,675 [281] [DEBUG] [app] Ending request: urn:request:07945846-fed6-484a-9808-d0a032538ce4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:07945846-fed6-484a-9808-d0a032538ce4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:04:45,676 [278] [DEBUG] [app] Ending request: urn:request:4e7db7ff-f8bb-48e3-ab4d-c42723e5f592 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4e7db7ff-f8bb-48e3-ab4d-c42723e5f592', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:45,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:04:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:01.054492+00:00 (in 14.999491 seconds)
quotatotalworker stdout | 2024-04-22 04:04:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:01 UTC)" (scheduled at 2024-04-22 04:04:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:04:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:04:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:04:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:01 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:46,671 [279] [DEBUG] [app] Starting request: urn:request:d02b62b7-5e84-45a7-ad6a-4ebc2b5dbffd (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:46,672 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,672 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,672 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,684 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:46,691 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,691 [279] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:46,692 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,695 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,697 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,699 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:46,701 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,701 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,702 [279] [DEBUG] [app] Ending request: urn:request:d02b62b7-5e84-45a7-ad6a-4ebc2b5dbffd (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:d02b62b7-5e84-45a7-ad6a-4ebc2b5dbffd', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:46,702 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:46,703 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1546 0.035)
buildlogsarchiver stdout | 2024-04-22 04:04:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:04:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:17.052354+00:00 (in 29.999508 seconds)
buildlogsarchiver stdout | 2024-04-22 04:04:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:17 UTC)" (scheduled at 2024-04-22 04:04:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:04:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 4, 47, 53201), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:04:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:04:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:04:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:04:50,065 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:04:51,525 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:04:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:03.759375+00:00 (in 9.999457 seconds)
notificationworker stdout | 2024-04-22 04:04:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:03 UTC)" (scheduled at 2024-04-22 04:04:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 53, 760366), True, datetime.datetime(2024, 4, 22, 4, 4, 53, 760366), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:04:55,165 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:04:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 04:04:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:26 UTC)" (scheduled at 2024-04-22 04:04:56.873109+00:00)
securityworker stdout | 2024-04-22 04:04:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:04:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:04:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
repositoryactioncounter stdout | 2024-04-22 04:04:56,896 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:04:56,919 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:04:56,928 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:56,929 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:56,930 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 59, 56, 880441), 1, 2])
securityworker stdout | 2024-04-22 04:04:56,932 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:56,932 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:56,933 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 59, 56, 880441), 1, 2])
securityworker stdout | 2024-04-22 04:04:56,935 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:56,935 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:56,937 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,937 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:56,937 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:26 UTC)" executed successfully
quotatotalworker stdout | 2024-04-22 04:04:58,129 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:04:58,249 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:05:00,065 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:05:00,074 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:05:00,076 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:05:00,079 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:05:00,083 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:05:00,128 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:05:00,287 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:05:00,653 [281] [DEBUG] [app] Starting request: urn:request:4b8ef757-c5f6-4cec-a7d1-475d07746872 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:00,653 [278] [DEBUG] [app] Starting request: urn:request:0c942ae5-f053-461f-a531-2b113e059d1a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:00,656 [284] [DEBUG] [app] Starting request: urn:request:de684d59-f616-49b7-9ce7-98be75ff6032 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:00,656 [284] [DEBUG] [app] Ending request: urn:request:de684d59-f616-49b7-9ce7-98be75ff6032 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:de684d59-f616-49b7-9ce7-98be75ff6032', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:05:00,657 [292] [DEBUG] [app] Starting request: urn:request:e851dcbd-2a3b-4bdd-909d-1f4d5b2b8c3c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:05:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:05:00,657 [292] [DEBUG] [app] Ending request: urn:request:e851dcbd-2a3b-4bdd-909d-1f4d5b2b8c3c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e851dcbd-2a3b-4bdd-909d-1f4d5b2b8c3c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:05:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:00,659 [282] [DEBUG] [app] Starting request: urn:request:4084f4ec-85b9-4679-a24d-4e337bc26bf5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:00,660 [282] [DEBUG] [app] Ending request: urn:request:4084f4ec-85b9-4679-a24d-4e337bc26bf5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4084f4ec-85b9-4679-a24d-4e337bc26bf5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:00,661 [279] [DEBUG] [app] Starting request: urn:request:1a94e349-50ed-449c-b575-a1430e72b9b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:00,661 [279] [DEBUG] [app] Ending request: urn:request:1a94e349-50ed-449c-b575-a1430e72b9b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1a94e349-50ed-449c-b575-a1430e72b9b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:05:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:00,674 [281] [DEBUG] [app] Ending request: urn:request:4b8ef757-c5f6-4cec-a7d1-475d07746872 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4b8ef757-c5f6-4cec-a7d1-475d07746872', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:00,676 [278] [DEBUG] [app] Ending request: urn:request:0c942ae5-f053-461f-a531-2b113e059d1a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0c942ae5-f053-461f-a531-2b113e059d1a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:05:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:16.054492+00:00 (in 14.999459 seconds)
quotatotalworker stdout | 2024-04-22 04:05:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:16 UTC)" (scheduled at 2024-04-22 04:05:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:05:01,129 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:05:01,307 [281] [DEBUG] [app] Starting request: urn:request:37fd8205-a151-46b1-97ba-084917b10a9d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:01,307 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,308 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,308 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,327 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,327 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,327 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,329 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:01,335 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,336 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:01,341 [281] [DEBUG] [app] Ending request: urn:request:37fd8205-a151-46b1-97ba-084917b10a9d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:37fd8205-a151-46b1-97ba-084917b10a9d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:01,341 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:01,341 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:01 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 404 136 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:01 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 404 136 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1562 0.035)
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:16.552337+00:00 (in 13.995624 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:02 UTC)" (scheduled at 2024-04-22 04:05:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:05:02,710 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:05:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:13.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:05:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:13 UTC)" (scheduled at 2024-04-22 04:05:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 3, 760262), True, datetime.datetime(2024, 4, 22, 4, 5, 3, 760262), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:04,023 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:05:04,297 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:05:04,498 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:05:04,678 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:05:04,681 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:05:04,685 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:05:05,563 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:05:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:26.873109+00:00 (in 21.000717 seconds)
securityworker stdout | 2024-04-22 04:05:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:35 UTC)" (scheduled at 2024-04-22 04:05:05.871852+00:00)
securityworker stdout | 2024-04-22 04:05:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:05:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:05:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:13.555667+00:00 (in 7.002683 seconds)
repositorygcworker stdout | 2024-04-22 04:05:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:06 UTC)" (scheduled at 2024-04-22 04:05:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:05:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:05:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 6, 553263), True, datetime.datetime(2024, 4, 22, 4, 5, 6, 553263), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:05:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:05:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:05:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:05:06,753 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:05:06,847 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:05:06,961 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:05:07,163 [281] [DEBUG] [app] Starting request: urn:request:b17cfff5-71ef-47b7-8a87-2ed7a7c8fdfe (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:07,163 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,163 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,164 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:07,173 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:07,173 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,176 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:07,183 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,184 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:07,187 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:07,188 [281] [DEBUG] [peewee] ('INSERT INTO "repositoryauthorizedemail" ("repository_id", "email", "code", "confirmed") VALUES (%s, %s, %s, %s) RETURNING "repositoryauthorizedemail"."id"', [1, 'hu_weihua@163.com', 'X02X45ST1YHE8C4H', False])
blobuploadcleanupworker stdout | 2024-04-22 04:05:07,970 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:05:09,299 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:05:09,357 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:05:09,669 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:05:09,771 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:05:10,981 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:05:10,984 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:05:10,988 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:05:10,992 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:05:10,994 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:05:10,998 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:05:11,001 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:05:11,005 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:05:11,007 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:05:11,044 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:05:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:05:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:41.264267+00:00 (in 29.999518 seconds)
autopruneworker stdout | 2024-04-22 04:05:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:41 UTC)" (scheduled at 2024-04-22 04:05:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:05:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758651271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:05:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:05:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:05:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:11,465 [281] [DEBUG] [util.useremails] Sent email: '[Red Hat Quay] Please verify your e-mail address for repository build_test/pushno'
gunicorn-web stdout | 2024-04-22 04:05:11,468 [281] [DEBUG] [app] Ending request: urn:request:b17cfff5-71ef-47b7-8a87-2ed7a7c8fdfe (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:b17cfff5-71ef-47b7-8a87-2ed7a7c8fdfe', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': {}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:11,469 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:11,469 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:11 +0000] "POST /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:11 +0000] "POST /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (4.308 1731 4.307)
repositorygcworker stdout | 2024-04-22 04:05:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:06.552482+00:00 (in 52.996284 seconds)
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:13 UTC)" (scheduled at 2024-04-22 04:05:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:05:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:19.762424+00:00 (in 6.002584 seconds)
notificationworker stdout | 2024-04-22 04:05:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:23 UTC)" (scheduled at 2024-04-22 04:05:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 13, 760220), True, datetime.datetime(2024, 4, 22, 4, 5, 13, 760220), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:13,806 [278] [DEBUG] [app] Starting request: urn:request:bf7edd6b-53d9-400a-a8c8-6b708e45138b (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:13,807 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,807 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,808 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:13,817 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:13,817 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:13,817 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,820 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:13,826 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,828 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:13,831 [278] [DEBUG] [app] Ending request: urn:request:bf7edd6b-53d9-400a-a8c8-6b708e45138b (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:bf7edd6b-53d9-400a-a8c8-6b708e45138b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:13,831 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:13 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.026)
gunicorn-web stdout | 2024-04-22 04:05:13,831 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:13 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gcworker stdout | 2024-04-22 04:05:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:05:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:44.952062+00:00 (in 29.999457 seconds)
gcworker stdout | 2024-04-22 04:05:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:44 UTC)" (scheduled at 2024-04-22 04:05:14.952062+00:00)
gcworker stdout | 2024-04-22 04:05:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549114953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:05:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:05:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:05:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:15,653 [278] [DEBUG] [app] Starting request: urn:request:8bfcd355-8228-45fb-90e0-2bc9e3d539f7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:15,653 [282] [DEBUG] [app] Starting request: urn:request:13a0e060-7559-4be3-b889-01799356b3ff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:15,656 [290] [DEBUG] [app] Starting request: urn:request:1ae123a4-7f34-4555-a795-d4425aa73372 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [290] [DEBUG] [app] Ending request: urn:request:1ae123a4-7f34-4555-a795-d4425aa73372 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1ae123a4-7f34-4555-a795-d4425aa73372', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [289] [DEBUG] [app] Starting request: urn:request:10acb8ea-9877-4518-91fd-cc4356446950 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [289] [DEBUG] [app] Ending request: urn:request:10acb8ea-9877-4518-91fd-cc4356446950 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:10acb8ea-9877-4518-91fd-cc4356446950', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:05:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:15,660 [281] [DEBUG] [app] Starting request: urn:request:f9d30314-b961-450f-870d-9b73f26c76c6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:15,660 [281] [DEBUG] [app] Ending request: urn:request:f9d30314-b961-450f-870d-9b73f26c76c6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f9d30314-b961-450f-870d-9b73f26c76c6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:15,661 [281] [DEBUG] [app] Starting request: urn:request:0e9ea044-11c6-4050-a856-3542fad2a7c9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:15,661 [281] [DEBUG] [app] Ending request: urn:request:0e9ea044-11c6-4050-a856-3542fad2a7c9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0e9ea044-11c6-4050-a856-3542fad2a7c9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 04:05:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:15,675 [282] [DEBUG] [app] Ending request: urn:request:13a0e060-7559-4be3-b889-01799356b3ff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:13a0e060-7559-4be3-b889-01799356b3ff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:15,676 [278] [DEBUG] [app] Ending request: urn:request:8bfcd355-8228-45fb-90e0-2bc9e3d539f7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8bfcd355-8228-45fb-90e0-2bc9e3d539f7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:05:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:05:15,821 [278] [DEBUG] [app] Starting request: urn:request:5f0bda0b-8bce-4dbb-8536-96a4d8abfb27 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:15,821 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,821 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,822 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,833 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,833 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,835 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:15,842 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,843 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:15,846 [278] [DEBUG] [app] Ending request: urn:request:5f0bda0b-8bce-4dbb-8536-96a4d8abfb27 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:5f0bda0b-8bce-4dbb-8536-96a4d8abfb27', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:15,847 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1581 0.027)
gunicorn-web stdout | 2024-04-22 04:05:15,847 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:15 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
quotatotalworker stdout | 2024-04-22 04:05:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:31.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:05:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:31 UTC)" (scheduled at 2024-04-22 04:05:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:02.556208+00:00 (in 46.003297 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:16 UTC)" (scheduled at 2024-04-22 04:05:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 16, 553313), True, datetime.datetime(2024, 4, 22, 4, 5, 16, 553313), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,571 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:05:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:47.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 04:05:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:47 UTC)" (scheduled at 2024-04-22 04:05:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:05:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 5, 17, 53299), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:05:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:05:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:05:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [app] Starting request: urn:request:d72ea63f-4cd8-485f-8b91-ef722eba2dae (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:18,557 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:18,557 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:18,557 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,560 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:18,566 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,567 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:18,570 [282] [DEBUG] [app] Ending request: urn:request:d72ea63f-4cd8-485f-8b91-ef722eba2dae (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:d72ea63f-4cd8-485f-8b91-ef722eba2dae', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:18,570 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:18,571 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:05:18 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:05:18 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.026)
notificationworker stdout | 2024-04-22 04:05:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:23.759375+00:00 (in 3.996461 seconds)
notificationworker stdout | 2024-04-22 04:05:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:19 UTC)" (scheduled at 2024-04-22 04:05:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:05:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:05:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:05:20,084 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:05:21,560 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:05:21,914 [281] [DEBUG] [app] Starting request: urn:request:ee0659d5-70b6-49b0-8002-eaf864236c64 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:05:21,914 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,914 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,915 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:21,934 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,937 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:21,944 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,945 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:21,948 [281] [DEBUG] [app] Ending request: urn:request:ee0659d5-70b6-49b0-8002-eaf864236c64 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:ee0659d5-70b6-49b0-8002-eaf864236c64', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:21,949 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:21,949 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:05:21 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:05:21 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1581 0.036)
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:43.057186+00:00 (in 20.997683 seconds)
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:22 UTC)" (scheduled at 2024-04-22 04:05:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:05:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:33.759375+00:00 (in 9.999515 seconds)
notificationworker stdout | 2024-04-22 04:05:23,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:33 UTC)" (scheduled at 2024-04-22 04:05:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 23, 760109), True, datetime.datetime(2024, 4, 22, 4, 5, 23, 760109), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:24.361582+00:00 (in 59.999456 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:24 UTC)" (scheduled at 2024-04-22 04:05:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:24 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:24,840 [278] [DEBUG] [app] Starting request: urn:request:ad1c94e5-077a-45e4-8e5b-cd2c772852af (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:24,840 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,841 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,841 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,854 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:24,860 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,861 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:24,864 [278] [DEBUG] [app] Ending request: urn:request:ad1c94e5-077a-45e4-8e5b-cd2c772852af (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:ad1c94e5-077a-45e4-8e5b-cd2c772852af', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:24,865 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:24,865 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:24 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:24 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.026)
builder stdout | 2024-04-22 04:05:25,189 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:35.871852+00:00 (in 8.998226 seconds)
securityworker stdout | 2024-04-22 04:05:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:56 UTC)" (scheduled at 2024-04-22 04:05:26.873109+00:00)
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:05:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:05:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 0, 26, 880730), 1, 2])
securityworker stdout | 2024-04-22 04:05:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 0, 26, 880730), 1, 2])
securityworker stdout | 2024-04-22 04:05:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:05:26,927 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:05:27,259 [282] [DEBUG] [app] Starting request: urn:request:760ed4ee-95c2-4650-922b-3a80024ec2b8 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:27,259 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,259 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,260 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,272 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:27,278 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,279 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:27,282 [282] [DEBUG] [app] Ending request: urn:request:760ed4ee-95c2-4650-922b-3a80024ec2b8 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:760ed4ee-95c2-4650-922b-3a80024ec2b8', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:27,282 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:27,283 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:27 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:27 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
quotatotalworker stdout | 2024-04-22 04:05:28,165 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:05:28,286 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:05:29,260 [282] [DEBUG] [app] Starting request: urn:request:63642f52-c9d9-413e-8b16-08f5aa4e0e86 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:29,261 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,261 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,261 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:29,270 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,273 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:29,279 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,280 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:29,283 [282] [DEBUG] [app] Ending request: urn:request:63642f52-c9d9-413e-8b16-08f5aa4e0e86 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:63642f52-c9d9-413e-8b16-08f5aa4e0e86', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:29,283 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:29,284 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:29 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:29 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
gunicorn-web stdout | 2024-04-22 04:05:30,075 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:05:30,085 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:05:30,090 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:05:30,093 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:05:30,095 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:05:30,164 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:05:30,292 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:05:30,653 [281] [DEBUG] [app] Starting request: urn:request:fc0530cf-00a2-463a-b2b4-d0ae30bc96ba (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:30,653 [279] [DEBUG] [app] Starting request: urn:request:1f572d7f-7085-41c7-917a-478affcd3ace (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:30,656 [284] [DEBUG] [app] Starting request: urn:request:08235199-bf76-4ea9-b4bb-30de9be55313 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:30,656 [284] [DEBUG] [app] Ending request: urn:request:08235199-bf76-4ea9-b4bb-30de9be55313 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:08235199-bf76-4ea9-b4bb-30de9be55313', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:30,656 [291] [DEBUG] [app] Starting request: urn:request:a1d2f663-c9dc-4548-b8e5-a5c4bb1011a5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:05:30,657 [291] [DEBUG] [app] Ending request: urn:request:a1d2f663-c9dc-4548-b8e5-a5c4bb1011a5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1d2f663-c9dc-4548-b8e5-a5c4bb1011a5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:05:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:05:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:30,659 [282] [DEBUG] [app] Starting request: urn:request:e235d4d6-84de-4fa2-9b2f-862c25f5c6af (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:30,660 [282] [DEBUG] [app] Ending request: urn:request:e235d4d6-84de-4fa2-9b2f-862c25f5c6af (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e235d4d6-84de-4fa2-9b2f-862c25f5c6af', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:30,660 [278] [DEBUG] [app] Starting request: urn:request:ff3d3d84-ea85-4613-bb09-bf36dc46a8f0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:30,661 [278] [DEBUG] [app] Ending request: urn:request:ff3d3d84-ea85-4613-bb09-bf36dc46a8f0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff3d3d84-ea85-4613-bb09-bf36dc46a8f0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:30,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:30,674 [281] [DEBUG] [app] Ending request: urn:request:fc0530cf-00a2-463a-b2b4-d0ae30bc96ba (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fc0530cf-00a2-463a-b2b4-d0ae30bc96ba', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:05:30,675 [279] [DEBUG] [app] Ending request: urn:request:1f572d7f-7085-41c7-917a-478affcd3ace (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1f572d7f-7085-41c7-917a-478affcd3ace', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:05:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:46.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:05:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:46 UTC)" (scheduled at 2024-04-22 04:05:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:05:31,165 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [app] Starting request: urn:request:de768fac-96de-443a-8823-71012ecdef40 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,286 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:31,292 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,293 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:31,295 [281] [DEBUG] [app] Ending request: urn:request:de768fac-96de-443a-8823-71012ecdef40 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:de768fac-96de-443a-8823-71012ecdef40', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:31,296 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:31,296 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:31 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:31 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1562 0.023)
notificationworker stdout | 2024-04-22 04:05:32,719 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-web stdout | 2024-04-22 04:05:33,287 [282] [DEBUG] [app] Starting request: urn:request:1f37526d-16a5-4d93-b88e-5241bd41b3d9 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:33,287 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,287 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,288 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,300 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:33,307 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,308 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:33,311 [282] [DEBUG] [app] Ending request: urn:request:1f37526d-16a5-4d93-b88e-5241bd41b3d9 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:1f37526d-16a5-4d93-b88e-5241bd41b3d9', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:33,311 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:33,312 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:33 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:33 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1562 0.027)
notificationworker stdout | 2024-04-22 04:05:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:43.759375+00:00 (in 9.999476 seconds)
notificationworker stdout | 2024-04-22 04:05:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:43 UTC)" (scheduled at 2024-04-22 04:05:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 33, 760322), True, datetime.datetime(2024, 4, 22, 4, 5, 33, 760322), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:33,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:33,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:33,776 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:34,048 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:05:34,324 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:05:34,534 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:05:34,686 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:05:34,689 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:05:34,693 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gunicorn-web stdout | 2024-04-22 04:05:35,289 [279] [DEBUG] [app] Starting request: urn:request:ef7d74bd-77f2-4ae2-aa77-30dc9a19706d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:35,289 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,289 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,290 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,303 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:35,310 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,311 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:35,314 [279] [DEBUG] [app] Ending request: urn:request:ef7d74bd-77f2-4ae2-aa77-30dc9a19706d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:ef7d74bd-77f2-4ae2-aa77-30dc9a19706d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:35,315 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:35,315 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:35 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:35 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1562 0.027)
logrotateworker stdout | 2024-04-22 04:05:35,600 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:56.873109+00:00 (in 21.000738 seconds)
securityworker stdout | 2024-04-22 04:05:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:05 UTC)" (scheduled at 2024-04-22 04:05:35.871852+00:00)
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:05:36,788 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:05:36,863 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:05:36,996 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:05:37,301 [282] [DEBUG] [app] Starting request: urn:request:6e6b25e0-22cf-4213-85c1-9a5a9d7216bb (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:37,301 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,301 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,302 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,314 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:37,321 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,321 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:37,324 [282] [DEBUG] [app] Ending request: urn:request:6e6b25e0-22cf-4213-85c1-9a5a9d7216bb (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:6e6b25e0-22cf-4213-85c1-9a5a9d7216bb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:37,325 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:37,325 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:37 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:37 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.025)
blobuploadcleanupworker stdout | 2024-04-22 04:05:38,006 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
gunicorn-web stdout | 2024-04-22 04:05:39,304 [281] [DEBUG] [app] Starting request: urn:request:f6fcf29d-b978-4d83-9790-91c3ceb9b85a (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:39,304 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,304 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,305 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,315 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,317 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:39,323 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,324 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:39,327 [281] [DEBUG] [app] Ending request: urn:request:f6fcf29d-b978-4d83-9790-91c3ceb9b85a (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:f6fcf29d-b978-4d83-9790-91c3ceb9b85a', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:39,327 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:39,328 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:39 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:39 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.025)
securityworker stdout | 2024-04-22 04:05:39,335 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:05:39,378 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:41.564959+00:00 (in 1.997470 seconds)
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:39 UTC)" (scheduled at 2024-04-22 04:05:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:05:39,697 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:05:39,798 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:05:40,992 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:05:40,996 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:05:40,999 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:05:41,001 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:05:41,004 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:05:41,007 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:05:41,010 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:05:41,013 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:05:41,018 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:05:41,080 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:05:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:05:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 04:05:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:11 UTC)" (scheduled at 2024-04-22 04:05:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:05:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758681271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:05:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:05:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:05:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:11 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:41,319 [281] [DEBUG] [app] Starting request: urn:request:04b38fe6-7c5c-4459-a7ef-3dfddc17bd89 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:41,319 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,319 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,320 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:41,328 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:41,328 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:41,328 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,331 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:41,337 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,338 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:41,341 [281] [DEBUG] [app] Ending request: urn:request:04b38fe6-7c5c-4459-a7ef-3dfddc17bd89 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:04b38fe6-7c5c-4459-a7ef-3dfddc17bd89', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:41,341 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:41 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1562 0.023)
gunicorn-web stdout | 2024-04-22 04:05:41,342 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:41 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:39.566970+00:00 (in 58.001490 seconds)
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:41 UTC)" (scheduled at 2024-04-22 04:05:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:05:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 41, 565725), True, datetime.datetime(2024, 4, 22, 4, 5, 41, 565725), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:05:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:05:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:05:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:05:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:05:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:22.058978+00:00 (in 39.001275 seconds)
namespacegcworker stdout | 2024-04-22 04:05:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:43 UTC)" (scheduled at 2024-04-22 04:05:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:05:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:05:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 43, 58191), True, datetime.datetime(2024, 4, 22, 4, 5, 43, 58191), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:05:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:05:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:05:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:43 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:43,325 [281] [DEBUG] [app] Starting request: urn:request:9a3a633b-5b59-4809-bc4a-a915651a1e8f (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:43,325 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,325 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,326 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:43,334 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:43,334 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,337 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:43,343 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,344 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:43,347 [281] [DEBUG] [app] Ending request: urn:request:9a3a633b-5b59-4809-bc4a-a915651a1e8f (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:9a3a633b-5b59-4809-bc4a-a915651a1e8f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:43,347 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:43,348 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:43 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:43 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
notificationworker stdout | 2024-04-22 04:05:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:53.759375+00:00 (in 9.999457 seconds)
notificationworker stdout | 2024-04-22 04:05:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:53 UTC)" (scheduled at 2024-04-22 04:05:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 43, 760235), True, datetime.datetime(2024, 4, 22, 4, 5, 43, 760235), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:05:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:05:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:14.952062+00:00 (in 29.999490 seconds)
gcworker stdout | 2024-04-22 04:05:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:14 UTC)" (scheduled at 2024-04-22 04:05:44.952062+00:00)
gcworker stdout | 2024-04-22 04:05:44,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 04:05:44,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549144962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:05:44,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:05:44,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:05:44,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:45,335 [282] [DEBUG] [app] Starting request: urn:request:489cfe9f-6b65-4551-9110-c00864736143 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:45,335 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,335 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,336 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,348 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:45,354 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,355 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:45,357 [282] [DEBUG] [app] Ending request: urn:request:489cfe9f-6b65-4551-9110-c00864736143 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:489cfe9f-6b65-4551-9110-c00864736143', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:45,358 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:45,358 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:45 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1562 0.024)
gunicorn-web stdout | 2024-04-22 04:05:45,652 [282] [DEBUG] [app] Starting request: urn:request:5a04a19e-49fd-4e4a-82fa-b6b32e40f5af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:45,653 [278] [DEBUG] [app] Starting request: urn:request:7bb831e0-24c3-46f3-a3dd-114613a8349b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [284] [DEBUG] [app] Starting request: urn:request:3cba469c-ec88-49d3-a45a-312728a6c6a8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [291] [DEBUG] [app] Starting request: urn:request:197b9b96-05a5-4a18-ba4b-0edba4601e83 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [284] [DEBUG] [app] Ending request: urn:request:3cba469c-ec88-49d3-a45a-312728a6c6a8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3cba469c-ec88-49d3-a45a-312728a6c6a8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [291] [DEBUG] [app] Ending request: urn:request:197b9b96-05a5-4a18-ba4b-0edba4601e83 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:197b9b96-05a5-4a18-ba4b-0edba4601e83', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:05:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:05:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:45,659 [282] [DEBUG] [app] Starting request: urn:request:9c01edd9-8433-445b-8195-347f63de2d34 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:45,659 [282] [DEBUG] [app] Ending request: urn:request:9c01edd9-8433-445b-8195-347f63de2d34 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9c01edd9-8433-445b-8195-347f63de2d34', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:45,659 [279] [DEBUG] [app] Starting request: urn:request:104725a9-aab8-4359-bb5c-bd8db8d5fe3f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:45,660 [279] [DEBUG] [app] Ending request: urn:request:104725a9-aab8-4359-bb5c-bd8db8d5fe3f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:104725a9-aab8-4359-bb5c-bd8db8d5fe3f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:45,674 [282] [DEBUG] [app] Ending request: urn:request:5a04a19e-49fd-4e4a-82fa-b6b32e40f5af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5a04a19e-49fd-4e4a-82fa-b6b32e40f5af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:45,674 [278] [DEBUG] [app] Ending request: urn:request:7bb831e0-24c3-46f3-a3dd-114613a8349b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7bb831e0-24c3-46f3-a3dd-114613a8349b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:05:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:01.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:05:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:01 UTC)" (scheduled at 2024-04-22 04:05:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:05:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:17.052354+00:00 (in 29.999434 seconds)
buildlogsarchiver stdout | 2024-04-22 04:05:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:17 UTC)" (scheduled at 2024-04-22 04:05:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:05:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 5, 47, 53302), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:05:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:05:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:05:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:17 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:47,348 [282] [DEBUG] [app] Starting request: urn:request:c8eac079-bf62-411d-9478-879741f05408 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:47,348 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,348 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,349 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,360 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:47,367 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,368 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:47,371 [282] [DEBUG] [app] Ending request: urn:request:c8eac079-bf62-411d-9478-879741f05408 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:c8eac079-bf62-411d-9478-879741f05408', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:47,371 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:47,371 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:47 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:47 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1562 0.024)
gunicorn-web stdout | 2024-04-22 04:05:49,356 [282] [DEBUG] [app] Starting request: urn:request:8f193ac4-a424-4917-8721-fbba291387b2 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:49,356 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,357 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,357 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:49,366 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,369 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:49,376 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,377 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:49,379 [282] [DEBUG] [app] Ending request: urn:request:8f193ac4-a424-4917-8721-fbba291387b2 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:8f193ac4-a424-4917-8721-fbba291387b2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:49,380 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:49,380 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:49 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:49 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
gunicorn-web stdout | 2024-04-22 04:05:49,800 [278] [DEBUG] [app] Starting request: urn:request:86b9d51e-722a-4b03-befd-8f0239237e66 (/authrepoemail) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:49,801 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."code" = %s) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['X02X45ST1YHE8C4H', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:49,811 [278] [DEBUG] [peewee] ('UPDATE "repositoryauthorizedemail" SET "repository_id" = %s, "email" = %s, "code" = %s, "confirmed" = %s WHERE ("repositoryauthorizedemail"."id" = %s)', [1, 'hu_weihua@163.com', 'X02X45ST1YHE8C4H', True, 1])
gunicorn-web stdout | 2024-04-22 04:05:49,818 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,818 [278] [DEBUG] [app] Ending request: urn:request:86b9d51e-722a-4b03-befd-8f0239237e66 (/authrepoemail) {'endpoint': 'web.confirm_repo_email', 'request_id': 'urn:request:86b9d51e-722a-4b03-befd-8f0239237e66', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/authrepoemail?code=X02X45ST1YHE8C4H', 'path': '/authrepoemail', 'parameters': {'code': 'X02X45ST1YHE8C4H'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:49,818 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:49,819 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:49 +0000] "GET /authrepoemail?code=X02X45ST1YHE8C4H HTTP/1.0" 200 790 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:49 +0000] "GET /authrepoemail?code=X02X45ST1YHE8C4H HTTP/1.1" 200 484 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.020 1371 0.020)
expiredappspecifictokenworker stdout | 2024-04-22 04:05:50,113 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [app] Starting request: urn:request:ecc5df99-7d9b-4c12-a531-7aa5f913d648 (/favicon.ico) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:50,542 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:50,542 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:50,542 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:50,543 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['favicon.ico', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:50,548 [278] [DEBUG] [app] Ending request: urn:request:ecc5df99-7d9b-4c12-a531-7aa5f913d648 (/favicon.ico) {'endpoint': 'web.redirect_to_namespace', 'request_id': 'urn:request:ecc5df99-7d9b-4c12-a531-7aa5f913d648', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/favicon.ico', 'path': '/favicon.ico', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:50,548 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:50,549 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:50 +0000] "GET /favicon.ico HTTP/1.0" 404 93294 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/authrepoemail?code=X02X45ST1YHE8C4H" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:50 +0000] "GET /favicon.ico HTTP/1.1" 404 14284 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/authrepoemail?code=X02X45ST1YHE8C4H" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1372 0.028)
gunicorn-web stdout | 2024-04-22 04:05:51,359 [278] [DEBUG] [app] Starting request: urn:request:c6b212b5-f6b7-4720-97ef-52ee242393f6 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:51,359 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,359 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,360 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,372 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:51,379 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,380 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:51,383 [278] [DEBUG] [app] Ending request: urn:request:c6b212b5-f6b7-4720-97ef-52ee242393f6 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:c6b212b5-f6b7-4720-97ef-52ee242393f6', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:51,383 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:51 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
gunicorn-web stdout | 2024-04-22 04:05:51,383 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:51 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:05:51,569 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:05:52,367 [278] [DEBUG] [app] Starting request: urn:request:984fc048-ad27-4f74-8b58-36a32b3f1843 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:52,367 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,367 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,368 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,380 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:52,386 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,387 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,391 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,394 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,396 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,399 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['email', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,401 [278] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['98da68a7-e4d8-463f-b0a3-50d4807bf84c', 1, 5, 1, 'push mail', '{"email": "hu_weihua@163.com"}', '{}', 0])
gunicorn-web stdout | 2024-04-22 04:05:52,406 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,408 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,410 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 5, 52, 408295), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "98da68a7-e4d8-463f-b0a3-50d4807bf84c", "event": "repo_push", "method": "email"}'])
gunicorn-web stdout | 2024-04-22 04:05:52,414 [278] [DEBUG] [app] Ending request: urn:request:984fc048-ad27-4f74-8b58-36a32b3f1843 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:984fc048-ad27-4f74-8b58-36a32b3f1843', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'email', 'config': {'email': 'hu_weihua@163.com'}, 'eventConfig': {}, 'title': 'push mail'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:52,415 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:52,415 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:52 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 199 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:52 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 199 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.051 1825 0.049)
gunicorn-web stdout | 2024-04-22 04:05:52,742 [278] [DEBUG] [app] Starting request: urn:request:312168b5-2bf3-45c1-96e6-5e4496842188 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:52,742 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,742 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,743 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,751 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:52,751 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:52,751 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,754 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:52,760 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,761 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,764 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,767 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,769 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,771 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758752771, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,774 [278] [DEBUG] [app] Ending request: urn:request:312168b5-2bf3-45c1-96e6-5e4496842188 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:312168b5-2bf3-45c1-96e6-5e4496842188', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:52,775 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:52,775 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:52 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:52 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1563 0.034)
gunicorn-web stdout | 2024-04-22 04:05:53,439 [278] [DEBUG] [app] Starting request: urn:request:c9c01030-07c2-4a09-8bb4-889af1a83322 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:53,440 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,440 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,440 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,452 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:53,458 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,458 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,459 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,461 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,464 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:05:53,466 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,466 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,466 [278] [DEBUG] [app] Ending request: urn:request:c9c01030-07c2-4a09-8bb4-889af1a83322 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:c9c01030-07c2-4a09-8bb4-889af1a83322', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:53,467 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:53,467 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1557 0.029)
notificationworker stdout | 2024-04-22 04:05:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:03.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 04:05:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:03 UTC)" (scheduled at 2024-04-22 04:05:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 53, 760334), True, datetime.datetime(2024, 4, 22, 4, 5, 53, 760334), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [app] Starting request: urn:request:45cc5f0f-4cdb-429e-a52c-c50d3d2ea8fb (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,885 [281] [DEBUG] [app] Starting request: urn:request:c6de9348-9171-4942-b2ed-691e6ed222ae (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:53,885 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,885 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,886 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,892 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,892 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,894 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:53,894 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:53,894 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:53,894 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,897 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:53,900 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,900 [278] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:05:53,903 [278] [DEBUG] [app] Ending request: urn:request:45cc5f0f-4cdb-429e-a52c-c50d3d2ea8fb (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:45cc5f0f-4cdb-429e-a52c-c50d3d2ea8fb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:53,903 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,903 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:53,904 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:05:53,904 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,907 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:05:53,910 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:05:53,912 [281] [DEBUG] [app] Ending request: urn:request:c6de9348-9171-4942-b2ed-691e6ed222ae (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:c6de9348-9171-4942-b2ed-691e6ed222ae', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:53,913 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:53,913 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1539 0.029)
gunicorn-web stdout | 2024-04-22 04:05:54,612 [278] [DEBUG] [app] Starting request: urn:request:d4d56c28-2fa6-4f1b-af18-90e988e5788c (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:54,613 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,613 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,613 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,625 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:54,632 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,633 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,636 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:05:54,639 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,641 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,643 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,645 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,648 [278] [DEBUG] [app] Ending request: urn:request:d4d56c28-2fa6-4f1b-af18-90e988e5788c (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:d4d56c28-2fa6-4f1b-af18-90e988e5788c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:54,648 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:54,649 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 632 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 632 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.037 1535 0.037)
gunicorn-web stdout | 2024-04-22 04:05:54,662 [278] [DEBUG] [app] Starting request: urn:request:ab7aa332-0991-489d-9890-ef5d7af43f8f (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:05:54,663 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,663 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,664 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,676 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:54,682 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,683 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,687 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:05:54,691 [278] [DEBUG] [app] Ending request: urn:request:ab7aa332-0991-489d-9890-ef5d7af43f8f (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:ab7aa332-0991-489d-9890-ef5d7af43f8f', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:54,692 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:05:54,692 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
builder stdout | 2024-04-22 04:05:55,226 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:05:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:05.871852+00:00 (in 8.998231 seconds)
securityworker stdout | 2024-04-22 04:05:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:26 UTC)" (scheduled at 2024-04-22 04:05:56.873109+00:00)
securityworker stdout | 2024-04-22 04:05:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:05:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:05:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 0, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:05:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 0, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:05:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:05:56,963 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:05:58,193 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:05:58,313 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:06:00,086 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:06:00,096 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:06:00,099 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:06:00,102 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:06:00,106 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:06:00,199 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:06:00,314 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:06:00,653 [282] [DEBUG] [app] Starting request: urn:request:02a9f02a-27b6-48af-9334-0914dafd742d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:00,653 [278] [DEBUG] [app] Starting request: urn:request:b82f1453-3dc4-4d75-a501-d82112731269 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [284] [DEBUG] [app] Starting request: urn:request:31606dc9-6ce6-4e8a-8c7f-d56c29a9a4c1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [288] [DEBUG] [app] Starting request: urn:request:3e04dac2-9f6c-45ba-8cb6-9286f97389b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [288] [DEBUG] [app] Ending request: urn:request:3e04dac2-9f6c-45ba-8cb6-9286f97389b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3e04dac2-9f6c-45ba-8cb6-9286f97389b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [284] [DEBUG] [app] Ending request: urn:request:31606dc9-6ce6-4e8a-8c7f-d56c29a9a4c1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:31606dc9-6ce6-4e8a-8c7f-d56c29a9a4c1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:00,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:06:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:00,659 [278] [DEBUG] [app] Starting request: urn:request:12eae20c-e251-450f-a1d5-7de0d49f277e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:00,659 [278] [DEBUG] [app] Ending request: urn:request:12eae20c-e251-450f-a1d5-7de0d49f277e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:12eae20c-e251-450f-a1d5-7de0d49f277e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:00,659 [281] [DEBUG] [app] Starting request: urn:request:9309bbc9-6a42-4949-af00-fdbb6c194f3b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:00,660 [281] [DEBUG] [app] Ending request: urn:request:9309bbc9-6a42-4949-af00-fdbb6c194f3b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9309bbc9-6a42-4949-af00-fdbb6c194f3b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:00,674 [278] [DEBUG] [app] Ending request: urn:request:b82f1453-3dc4-4d75-a501-d82112731269 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b82f1453-3dc4-4d75-a501-d82112731269', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:00,675 [282] [DEBUG] [app] Ending request: urn:request:02a9f02a-27b6-48af-9334-0914dafd742d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:02a9f02a-27b6-48af-9334-0914dafd742d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:06:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:06:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:16.054492+00:00 (in 14.999486 seconds)
quotatotalworker stdout | 2024-04-22 04:06:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:16 UTC)" (scheduled at 2024-04-22 04:06:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:06:01,185 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:16.552337+00:00 (in 13.995629 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:02 UTC)" (scheduled at 2024-04-22 04:06:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:02,755 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:06:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:13.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 04:06:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:13 UTC)" (scheduled at 2024-04-22 04:06:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 3, 760176), True, datetime.datetime(2024, 4, 22, 4, 6, 3, 760176), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:04,086 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:06:04,361 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:06:04,551 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:06:04,695 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:06:04,698 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:06:04,701 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:06:05,636 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:26.873109+00:00 (in 21.000728 seconds)
securityworker stdout | 2024-04-22 04:06:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:35 UTC)" (scheduled at 2024-04-22 04:06:05.871852+00:00)
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:06:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:06:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:13.555667+00:00 (in 7.002702 seconds)
repositorygcworker stdout | 2024-04-22 04:06:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:06 UTC)" (scheduled at 2024-04-22 04:06:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:06:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:06:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 6, 553217), True, datetime.datetime(2024, 4, 22, 4, 6, 6, 553217), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:06:06,568 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:06:06,568 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:06:06,568 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:06:06,816 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:06:06,899 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:06:07,032 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:06:07,577 [282] [DEBUG] [app] Starting request: urn:request:b49487c8-3317-495f-843e-def620fc0388 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:06:07,577 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,577 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,578 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,589 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:06:07,596 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,596 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:06:07,597 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:06:07,599 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:06:07,602 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:06:07,604 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,604 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,605 [282] [DEBUG] [app] Ending request: urn:request:b49487c8-3317-495f-843e-def620fc0388 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:b49487c8-3317-495f-843e-def620fc0388', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:06:07,605 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:07,605 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:06:07 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:06:07 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1546 0.029)
blobuploadcleanupworker stdout | 2024-04-22 04:06:08,043 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:06:09,346 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:06:09,391 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:06:09,734 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:06:09,816 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:06:11,003 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:06:11,006 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:06:11,009 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:06:11,013 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:06:11,015 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:06:11,018 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:06:11,021 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:06:11,025 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:06:11,028 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:06:11,117 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:06:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:06:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:41.264267+00:00 (in 29.999461 seconds)
autopruneworker stdout | 2024-04-22 04:06:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:41 UTC)" (scheduled at 2024-04-22 04:06:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:06:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758711271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:06:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:06:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:06:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:06:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:51.555445+00:00 (in 37.999282 seconds)
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:13 UTC)" (scheduled at 2024-04-22 04:06:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:19.762424+00:00 (in 6.002592 seconds)
notificationworker stdout | 2024-04-22 04:06:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:23 UTC)" (scheduled at 2024-04-22 04:06:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 13, 760267), True, datetime.datetime(2024, 4, 22, 4, 6, 13, 760267), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:06:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:06:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:44.952062+00:00 (in 29.999547 seconds)
gcworker stdout | 2024-04-22 04:06:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:44 UTC)" (scheduled at 2024-04-22 04:06:14.952062+00:00)
gcworker stdout | 2024-04-22 04:06:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549174952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:06:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:06:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:06:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:06:15,653 [279] [DEBUG] [app] Starting request: urn:request:36678427-ba78-4ae8-a833-deb70e9ff3bc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:15,653 [278] [DEBUG] [app] Starting request: urn:request:ea9e6ae4-a425-42a8-9748-bcf40803b051 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:15,656 [284] [DEBUG] [app] Starting request: urn:request:b59920b9-bb17-47a5-9712-ff5f0535e95d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:15,656 [288] [DEBUG] [app] Starting request: urn:request:47cb7599-79e9-4602-a534-e6e68b152f23 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [288] [DEBUG] [app] Ending request: urn:request:47cb7599-79e9-4602-a534-e6e68b152f23 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47cb7599-79e9-4602-a534-e6e68b152f23', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [284] [DEBUG] [app] Ending request: urn:request:b59920b9-bb17-47a5-9712-ff5f0535e95d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b59920b9-bb17-47a5-9712-ff5f0535e95d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:06:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:15,660 [282] [DEBUG] [app] Starting request: urn:request:3495c1eb-9bed-46b8-b564-82281d91dae0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:15,660 [281] [DEBUG] [app] Starting request: urn:request:490f0a0e-84c8-4143-97fb-86b51ca45bda (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:15,660 [282] [DEBUG] [app] Ending request: urn:request:3495c1eb-9bed-46b8-b564-82281d91dae0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3495c1eb-9bed-46b8-b564-82281d91dae0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:15,660 [281] [DEBUG] [app] Ending request: urn:request:490f0a0e-84c8-4143-97fb-86b51ca45bda (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:490f0a0e-84c8-4143-97fb-86b51ca45bda', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:06:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:06:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:15,674 [278] [DEBUG] [app] Ending request: urn:request:ea9e6ae4-a425-42a8-9748-bcf40803b051 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ea9e6ae4-a425-42a8-9748-bcf40803b051', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:06:15,675 [279] [DEBUG] [app] Ending request: urn:request:36678427-ba78-4ae8-a833-deb70e9ff3bc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:36678427-ba78-4ae8-a833-deb70e9ff3bc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:06:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:06:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:06:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:31.054492+00:00 (in 14.999462 seconds)
quotatotalworker stdout | 2024-04-22 04:06:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:31 UTC)" (scheduled at 2024-04-22 04:06:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:02.556208+00:00 (in 46.003252 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:16 UTC)" (scheduled at 2024-04-22 04:06:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 16, 553387), True, datetime.datetime(2024, 4, 22, 4, 6, 16, 553387), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:06:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:47.052354+00:00 (in 29.999435 seconds)
buildlogsarchiver stdout | 2024-04-22 04:06:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:47 UTC)" (scheduled at 2024-04-22 04:06:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:06:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 6, 17, 53298), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:06:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:06:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:06:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:23.759375+00:00 (in 3.996447 seconds)
notificationworker stdout | 2024-04-22 04:06:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:19 UTC)" (scheduled at 2024-04-22 04:06:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:06:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:06:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:06:20,150 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:06:21,579 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:43.057186+00:00 (in 20.997613 seconds)
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:22 UTC)" (scheduled at 2024-04-22 04:06:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:06:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:33.759375+00:00 (in 9.999523 seconds)
notificationworker stdout | 2024-04-22 04:06:23,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:33 UTC)" (scheduled at 2024-04-22 04:06:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 23, 760101), True, datetime.datetime(2024, 4, 22, 4, 6, 23, 760101), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:24 UTC)" (scheduled at 2024-04-22 04:06:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:06:25,248 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:06:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:35.871852+00:00 (in 8.998247 seconds)
securityworker stdout | 2024-04-22 04:06:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:56 UTC)" (scheduled at 2024-04-22 04:06:26.873109+00:00)
securityworker stdout | 2024-04-22 04:06:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:06:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:06:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 1, 26, 881377), 1, 2])
securityworker stdout | 2024-04-22 04:06:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 1, 26, 881377), 1, 2])
securityworker stdout | 2024-04-22 04:06:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:06:26,977 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:06:28,210 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:06:28,331 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:06:30,099 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:06:30,108 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:06:30,112 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:06:30,115 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:06:30,118 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:06:30,236 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:06:30,338 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:06:30,653 [281] [DEBUG] [app] Starting request: urn:request:e3036e78-6e05-4165-b43d-2cb35d9890ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:30,653 [282] [DEBUG] [app] Starting request: urn:request:4fe1dc7f-e883-4e75-8df6-67c90dcc4c81 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:30,656 [292] [DEBUG] [app] Starting request: urn:request:19a912a4-7268-442a-b884-8c7457de9bc3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:30,656 [292] [DEBUG] [app] Ending request: urn:request:19a912a4-7268-442a-b884-8c7457de9bc3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:19a912a4-7268-442a-b884-8c7457de9bc3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:30,656 [291] [DEBUG] [app] Starting request: urn:request:7ea9ddce-8093-4971-a456-507352bc049e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:06:30,657 [291] [DEBUG] [app] Ending request: urn:request:7ea9ddce-8093-4971-a456-507352bc049e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7ea9ddce-8093-4971-a456-507352bc049e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:06:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:06:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:30,659 [278] [DEBUG] [app] Starting request: urn:request:2e0c0482-f5a3-42c1-b547-1ef9d8ec2b47 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:30,660 [278] [DEBUG] [app] Ending request: urn:request:2e0c0482-f5a3-42c1-b547-1ef9d8ec2b47 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2e0c0482-f5a3-42c1-b547-1ef9d8ec2b47', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:30,660 [281] [DEBUG] [app] Starting request: urn:request:e7172bb1-35be-4165-b22a-39e47f46219d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:30,661 [281] [DEBUG] [app] Ending request: urn:request:e7172bb1-35be-4165-b22a-39e47f46219d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e7172bb1-35be-4165-b22a-39e47f46219d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:30,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:30,675 [281] [DEBUG] [app] Ending request: urn:request:e3036e78-6e05-4165-b43d-2cb35d9890ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e3036e78-6e05-4165-b43d-2cb35d9890ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:06:30,678 [282] [DEBUG] [app] Ending request: urn:request:4fe1dc7f-e883-4e75-8df6-67c90dcc4c81 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4fe1dc7f-e883-4e75-8df6-67c90dcc4c81', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:30,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:30,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
quotatotalworker stdout | 2024-04-22 04:06:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:46.054492+00:00 (in 14.999457 seconds)
quotatotalworker stdout | 2024-04-22 04:06:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:46 UTC)" (scheduled at 2024-04-22 04:06:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:06:31,223 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:06:32,790 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:06:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:43.759375+00:00 (in 9.999463 seconds)
notificationworker stdout | 2024-04-22 04:06:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:43 UTC)" (scheduled at 2024-04-22 04:06:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 33, 760231), True, datetime.datetime(2024, 4, 22, 4, 6, 33, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:34,114 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:06:34,383 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:06:34,587 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:06:34,703 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:06:34,706 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:06:34,710 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:06:35,667 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:56.873109+00:00 (in 21.000777 seconds)
securityworker stdout | 2024-04-22 04:06:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:05 UTC)" (scheduled at 2024-04-22 04:06:35.871852+00:00)
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:06:36,849 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:06:36,913 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:06:37,039 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:06:38,079 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:06:39,379 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:06:39,418 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:41.564959+00:00 (in 1.997447 seconds)
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:39 UTC)" (scheduled at 2024-04-22 04:06:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:06:39,757 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:06:39,852 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:06:41,013 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:06:41,015 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:06:41,020 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:06:41,022 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:06:41,026 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:06:41,029 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:06:41,033 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:06:41,036 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:06:41,039 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:06:41,136 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:06:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:06:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:11.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 04:06:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:11 UTC)" (scheduled at 2024-04-22 04:06:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:06:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758741271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:06:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:06:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:06:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:53.566665+00:00 (in 12.001203 seconds)
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:41 UTC)" (scheduled at 2024-04-22 04:06:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:06:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 41, 565682), True, datetime.datetime(2024, 4, 22, 4, 6, 41, 565682), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:06:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:06:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:06:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:06:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:06:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:22.058978+00:00 (in 39.001333 seconds)
namespacegcworker stdout | 2024-04-22 04:06:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:43 UTC)" (scheduled at 2024-04-22 04:06:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:06:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:06:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 43, 58073), True, datetime.datetime(2024, 4, 22, 4, 6, 43, 58073), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:06:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:06:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:06:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:53.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:06:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:53 UTC)" (scheduled at 2024-04-22 04:06:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 43, 760157), True, datetime.datetime(2024, 4, 22, 4, 6, 43, 760157), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:06:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:06:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:14.952062+00:00 (in 29.999490 seconds)
gcworker stdout | 2024-04-22 04:06:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:14 UTC)" (scheduled at 2024-04-22 04:06:44.952062+00:00)
gcworker stdout | 2024-04-22 04:06:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549204953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:06:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:06:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:06:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:06:45,652 [278] [DEBUG] [app] Starting request: urn:request:485ab3f6-c626-463a-a0b7-4530949fe1c1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:45,652 [282] [DEBUG] [app] Starting request: urn:request:80181805-1137-4bfd-8601-70d71bdb3e61 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [284] [DEBUG] [app] Starting request: urn:request:86f8c61a-9fb1-49ac-b00f-b3752cbe248d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [292] [DEBUG] [app] Starting request: urn:request:13663872-2da0-4f02-bf8e-6c3e897e3fe7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [284] [DEBUG] [app] Ending request: urn:request:86f8c61a-9fb1-49ac-b00f-b3752cbe248d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:86f8c61a-9fb1-49ac-b00f-b3752cbe248d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [292] [DEBUG] [app] Ending request: urn:request:13663872-2da0-4f02-bf8e-6c3e897e3fe7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:13663872-2da0-4f02-bf8e-6c3e897e3fe7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:06:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:45,659 [281] [DEBUG] [app] Starting request: urn:request:23b6152d-4933-477d-9918-4779951ccd39 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:45,659 [281] [DEBUG] [app] Ending request: urn:request:23b6152d-4933-477d-9918-4779951ccd39 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:23b6152d-4933-477d-9918-4779951ccd39', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:06:45,660 [278] [DEBUG] [app] Starting request: urn:request:5a6f5783-c0f1-48ad-94b4-387e981da9eb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:45,660 [278] [DEBUG] [app] Ending request: urn:request:5a6f5783-c0f1-48ad-94b4-387e981da9eb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5a6f5783-c0f1-48ad-94b4-387e981da9eb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:45,674 [278] [DEBUG] [app] Ending request: urn:request:485ab3f6-c626-463a-a0b7-4530949fe1c1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:485ab3f6-c626-463a-a0b7-4530949fe1c1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:06:45,675 [282] [DEBUG] [app] Ending request: urn:request:80181805-1137-4bfd-8601-70d71bdb3e61 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:80181805-1137-4bfd-8601-70d71bdb3e61', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:06:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:06:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:01.054492+00:00 (in 14.999462 seconds)
quotatotalworker stdout | 2024-04-22 04:06:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:01 UTC)" (scheduled at 2024-04-22 04:06:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:06:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:17.052354+00:00 (in 29.999486 seconds)
buildlogsarchiver stdout | 2024-04-22 04:06:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:17 UTC)" (scheduled at 2024-04-22 04:06:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:06:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 6, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:06:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:06:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:06:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:06:50,186 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:06:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:06:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:06.552482+00:00 (in 14.996484 seconds)
repositorygcworker stdout | 2024-04-22 04:06:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:51 UTC)" (scheduled at 2024-04-22 04:06:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:06:51,557 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:06:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), True, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:06:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), True, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:06:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:06:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:06:51,614 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:06:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:06:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:39.566970+00:00 (in 45.999820 seconds)
exportactionlogsworker stdout | 2024-04-22 04:06:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:53 UTC)" (scheduled at 2024-04-22 04:06:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:06:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:06:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), True, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:06:53,640 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), True, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:06:53,643 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:06:53,643 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:03.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 04:06:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:03 UTC)" (scheduled at 2024-04-22 04:06:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 53, 760154), True, datetime.datetime(2024, 4, 22, 4, 6, 53, 760154), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:06:55,257 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:06:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:05.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 04:06:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:26 UTC)" (scheduled at 2024-04-22 04:06:56.873109+00:00)
securityworker stdout | 2024-04-22 04:06:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:06:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:06:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 1, 56, 881289), 1, 2])
securityworker stdout | 2024-04-22 04:06:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:56,900 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 1, 56, 881289), 1, 2])
securityworker stdout | 2024-04-22 04:06:56,902 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:56,902 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:56,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:56,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:06:57,010 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:06:58,217 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:06:58,345 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:07:00,109 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:07:00,117 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:07:00,124 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:07:00,127 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:07:00,129 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:07:00,272 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:07:00,374 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:07:00,653 [278] [DEBUG] [app] Starting request: urn:request:53433008-5812-4de1-ac40-0d055402e115 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:00,653 [279] [DEBUG] [app] Starting request: urn:request:834aa4d9-fc2b-45f8-a812-80f3209ee220 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [284] [DEBUG] [app] Starting request: urn:request:8df23a29-dcb2-4137-ac27-1dab8c82ab3b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [291] [DEBUG] [app] Starting request: urn:request:4de7fe5f-77c5-4de1-a3bd-6cda6f43ca8c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [284] [DEBUG] [app] Ending request: urn:request:8df23a29-dcb2-4137-ac27-1dab8c82ab3b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8df23a29-dcb2-4137-ac27-1dab8c82ab3b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [291] [DEBUG] [app] Ending request: urn:request:4de7fe5f-77c5-4de1-a3bd-6cda6f43ca8c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4de7fe5f-77c5-4de1-a3bd-6cda6f43ca8c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:07:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:07:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:00,659 [278] [DEBUG] [app] Starting request: urn:request:e56fafc0-1dcd-4e43-bd2a-6a1b4ace753e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:00,659 [278] [DEBUG] [app] Ending request: urn:request:e56fafc0-1dcd-4e43-bd2a-6a1b4ace753e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e56fafc0-1dcd-4e43-bd2a-6a1b4ace753e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:00,660 [282] [DEBUG] [app] Starting request: urn:request:8fea7862-b588-458d-afb9-dcd5ebd5ca50 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:00,660 [282] [DEBUG] [app] Ending request: urn:request:8fea7862-b588-458d-afb9-dcd5ebd5ca50 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8fea7862-b588-458d-afb9-dcd5ebd5ca50', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:00,674 [278] [DEBUG] [app] Ending request: urn:request:53433008-5812-4de1-ac40-0d055402e115 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:53433008-5812-4de1-ac40-0d055402e115', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:07:00,675 [279] [DEBUG] [app] Ending request: urn:request:834aa4d9-fc2b-45f8-a812-80f3209ee220 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:834aa4d9-fc2b-45f8-a812-80f3209ee220', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:07:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:16.054492+00:00 (in 14.999467 seconds)
quotatotalworker stdout | 2024-04-22 04:07:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:16 UTC)" (scheduled at 2024-04-22 04:07:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:07:01,248 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:07:02,485 [279] [DEBUG] [app] Starting request: urn:request:5d43079c-80bd-4ffe-bf65-b8940136614d (/repository/build_test/pushno/create-notification) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:02,493 [279] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class <class 'endpoints.api.repository.RepositoryTrust'>
gunicorn-web stdout | 2024-04-22 04:07:02,504 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:02,518 [279] [DEBUG] [app] Ending request: urn:request:5d43079c-80bd-4ffe-bf65-b8940136614d (/repository/build_test/pushno/create-notification) {'endpoint': 'web.repository', 'request_id': 'urn:request:5d43079c-80bd-4ffe-bf65-b8940136614d', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification', 'path': '/repository/build_test/pushno/create-notification', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:02,519 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:02 +0000] "GET /repository/build_test/pushno/create-notification HTTP/1.0" 200 93195 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:02 +0000] "GET /repository/build_test/pushno/create-notification HTTP/1.1" 200 14252 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1378 0.035)
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:16.552337+00:00 (in 13.995591 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:02 UTC)" (scheduled at 2024-04-22 04:07:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:02,800 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-web stdout | 2024-04-22 04:07:03,177 [279] [DEBUG] [app] Starting request: urn:request:fbbeab38-3af6-4cea-82c9-61a5197890b0 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:03,177 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,177 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,178 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:07:03,192 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,192 [279] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:07:03,195 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:07:03,197 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,199 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:07:03,202 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,204 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:07:03,206 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,208 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,208 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,209 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,213 [279] [DEBUG] [app] Ending request: urn:request:fbbeab38-3af6-4cea-82c9-61a5197890b0 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:fbbeab38-3af6-4cea-82c9-61a5197890b0', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,213 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:03,214 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/ HTTP/1.0" 200 989 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/ HTTP/1.1" 200 989 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1505 0.038)
gunicorn-web stdout | 2024-04-22 04:07:03,540 [282] [DEBUG] [app] Starting request: urn:request:ede5461d-a1c0-4d99-910c-d63bc2791ace (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:03,541 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,541 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,541 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,552 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:07:03,557 [282] [DEBUG] [app] Ending request: urn:request:ede5461d-a1c0-4d99-910c-d63bc2791ace (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:ede5461d-a1c0-4d99-910c-d63bc2791ace', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,557 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:03,558 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1518 0.019)
notificationworker stdout | 2024-04-22 04:07:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:13.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 04:07:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:13 UTC)" (scheduled at 2024-04-22 04:07:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 3, 760282), True, datetime.datetime(2024, 4, 22, 4, 7, 3, 760282), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:03,917 [281] [DEBUG] [app] Starting request: urn:request:fa0c7a42-46cf-4830-a85f-39b116bbefc4 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:03,917 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,917 [282] [DEBUG] [app] Starting request: urn:request:5de96e1b-16f8-4e94-b884-c95b0e1c9b4f (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:03,917 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,917 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,917 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,918 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,918 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,926 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,926 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,926 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,926 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:03,927 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,927 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,927 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:07:03,929 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:03,930 [282] [DEBUG] [app] Ending request: urn:request:5de96e1b-16f8-4e94-b884-c95b0e1c9b4f (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:5de96e1b-16f8-4e94-b884-c95b0e1c9b4f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,930 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:03,931 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.014 1508 0.015)
gunicorn-web stdout | 2024-04-22 04:07:03,935 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,935 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:03,936 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,938 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,941 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:07:03,943 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,943 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,943 [281] [DEBUG] [app] Ending request: urn:request:fa0c7a42-46cf-4830-a85f-39b116bbefc4 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:fa0c7a42-46cf-4830-a85f-39b116bbefc4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,944 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1546 0.029)
gunicorn-web stdout | 2024-04-22 04:07:03,944 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
buildlogsarchiver stdout | 2024-04-22 04:07:04,150 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-web stdout | 2024-04-22 04:07:04,272 [282] [DEBUG] [app] Starting request: urn:request:d7bce4a3-4681-450b-9a19-c09aa3a1875a (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:04,272 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,272 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,273 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:04,281 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:04,281 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:04,281 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 19, 4, 282334), datetime.datetime(2024, 4, 22, 4, 7, 4, 282370)])
gunicorn-web stdout | 2024-04-22 04:07:04,285 [282] [DEBUG] [app] Ending request: urn:request:d7bce4a3-4681-450b-9a19-c09aa3a1875a (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:d7bce4a3-4681-450b-9a19-c09aa3a1875a', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:04,285 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:04,285 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.014 1527 0.014)
gcworker stdout | 2024-04-22 04:07:04,409 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:07:04,623 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:07:04,711 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:07:04,714 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:07:04,719 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:07:05,703 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:26.873109+00:00 (in 21.000734 seconds)
securityworker stdout | 2024-04-22 04:07:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:35 UTC)" (scheduled at 2024-04-22 04:07:05.871852+00:00)
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:07:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:07:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:13.555667+00:00 (in 7.002663 seconds)
repositorygcworker stdout | 2024-04-22 04:07:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:06 UTC)" (scheduled at 2024-04-22 04:07:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:07:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:07:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 6, 553428), True, datetime.datetime(2024, 4, 22, 4, 7, 6, 553428), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:07:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:07:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:07:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:07:06,885 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:07:06,925 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:07:07,046 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:07:08,113 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:07:09,401 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:07:09,454 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:07:09,793 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:07:09,874 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:07:11,021 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:07:11,024 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:07:11,032 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:07:11,036 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:07:11,038 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:07:11,041 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:07:11,044 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:07:11,047 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:07:11,050 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:07:11,171 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:07:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:07:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:41.264267+00:00 (in 29.999451 seconds)
autopruneworker stdout | 2024-04-22 04:07:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:41 UTC)" (scheduled at 2024-04-22 04:07:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:07:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758771272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:07:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:07:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:07:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:07:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:06.552482+00:00 (in 52.996333 seconds)
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:13 UTC)" (scheduled at 2024-04-22 04:07:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:19.762424+00:00 (in 6.002592 seconds)
notificationworker stdout | 2024-04-22 04:07:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:23 UTC)" (scheduled at 2024-04-22 04:07:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 13, 760157), True, datetime.datetime(2024, 4, 22, 4, 7, 13, 760157), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:07:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:07:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:44.952062+00:00 (in 29.999501 seconds)
gcworker stdout | 2024-04-22 04:07:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:44 UTC)" (scheduled at 2024-04-22 04:07:14.952062+00:00)
gcworker stdout | 2024-04-22 04:07:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549234952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:07:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:07:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:07:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:15,653 [278] [DEBUG] [app] Starting request: urn:request:2f39bb77-5422-47ac-85fa-d1b1c7439a09 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:15,653 [279] [DEBUG] [app] Starting request: urn:request:109f4ac4-012f-495b-8394-2edd39e71c9c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:15,656 [284] [DEBUG] [app] Starting request: urn:request:0b0c5342-f1ce-4f62-94b4-350684b8ff0f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:15,656 [285] [DEBUG] [app] Starting request: urn:request:00087ee8-3c06-4af1-8125-791790b8d685 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [285] [DEBUG] [app] Ending request: urn:request:00087ee8-3c06-4af1-8125-791790b8d685 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:00087ee8-3c06-4af1-8125-791790b8d685', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [284] [DEBUG] [app] Ending request: urn:request:0b0c5342-f1ce-4f62-94b4-350684b8ff0f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0b0c5342-f1ce-4f62-94b4-350684b8ff0f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:07:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:15,660 [281] [DEBUG] [app] Starting request: urn:request:b56de5ad-c8c2-4b6a-9d34-7e1ff3dd2438 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:15,660 [282] [DEBUG] [app] Starting request: urn:request:dd696aa7-a5b9-4982-b35c-463be5ef2d1f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:15,660 [281] [DEBUG] [app] Ending request: urn:request:b56de5ad-c8c2-4b6a-9d34-7e1ff3dd2438 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b56de5ad-c8c2-4b6a-9d34-7e1ff3dd2438', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:15,660 [282] [DEBUG] [app] Ending request: urn:request:dd696aa7-a5b9-4982-b35c-463be5ef2d1f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dd696aa7-a5b9-4982-b35c-463be5ef2d1f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:15,674 [278] [DEBUG] [app] Ending request: urn:request:2f39bb77-5422-47ac-85fa-d1b1c7439a09 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f39bb77-5422-47ac-85fa-d1b1c7439a09', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:07:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:07:15,675 [279] [DEBUG] [app] Ending request: urn:request:109f4ac4-012f-495b-8394-2edd39e71c9c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:109f4ac4-012f-495b-8394-2edd39e71c9c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:07:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:07:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:16,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:31.054492+00:00 (in 14.999567 seconds)
quotatotalworker stdout | 2024-04-22 04:07:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:31 UTC)" (scheduled at 2024-04-22 04:07:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:21.555879+00:00 (in 5.002956 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:16 UTC)" (scheduled at 2024-04-22 04:07:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 16, 553353), True, datetime.datetime(2024, 4, 22, 4, 7, 16, 553353), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:07:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:07:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:47.052354+00:00 (in 29.999462 seconds)
buildlogsarchiver stdout | 2024-04-22 04:07:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:47 UTC)" (scheduled at 2024-04-22 04:07:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:07:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 7, 17, 53251), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:07:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:07:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:07:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:23.759375+00:00 (in 3.996391 seconds)
notificationworker stdout | 2024-04-22 04:07:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:19 UTC)" (scheduled at 2024-04-22 04:07:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:07:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:07:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:19 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:20,181 [281] [DEBUG] [app] Starting request: urn:request:811eed3c-9dad-486f-9ce0-ba1122bcedc5 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:20,181 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,181 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,182 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,196 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,199 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:20,206 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,207 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,211 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,214 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,216 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['webhook', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,218 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['638a67a2-7215-4c47-9e8f-1866b057fc27', 1, 5, 6, 'push webhook', '{"url": "https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119"}', '{}', 0])
expiredappspecifictokenworker stdout | 2024-04-22 04:07:20,222 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:07:20,228 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,230 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,233 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 7, 20, 230483), '10.131.0.9', '{"repo": "pushno", "namespace": "build_test", "notification_id": "638a67a2-7215-4c47-9e8f-1866b057fc27", "event": "repo_push", "method": "webhook"}'])
gunicorn-web stdout | 2024-04-22 04:07:20,237 [281] [DEBUG] [app] Ending request: urn:request:811eed3c-9dad-486f-9ce0-ba1122bcedc5 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:811eed3c-9dad-486f-9ce0-ba1122bcedc5', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'webhook', 'config': {'url': 'https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119'}, 'eventConfig': {}, 'title': 'push webhook'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:20,237 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:20,238 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:20 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 242 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:20 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 242 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.059 1887 0.059)
gunicorn-web stdout | 2024-04-22 04:07:20,574 [278] [DEBUG] [app] Starting request: urn:request:52182687-4f1d-461f-8153-d111a4350f3b (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:20,574 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,574 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,575 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,577 [282] [DEBUG] [app] Starting request: urn:request:3df003ac-9037-42a1-8f9a-88f6bddf2aa2 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:20,578 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,578 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,578 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,585 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,585 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,587 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:20,587 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:20,587 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:20,587 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,590 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:20,593 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,594 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,596 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,596 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,597 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,598 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,599 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,600 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,602 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:07:20,602 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,603 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,604 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,604 [282] [DEBUG] [app] Ending request: urn:request:3df003ac-9037-42a1-8f9a-88f6bddf2aa2 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:3df003ac-9037-42a1-8f9a-88f6bddf2aa2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:20,605 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:20,605 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758840604, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,605 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1576 0.029)
gunicorn-web stdout | 2024-04-22 04:07:20,608 [278] [DEBUG] [app] Ending request: urn:request:52182687-4f1d-461f-8153-d111a4350f3b (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:52182687-4f1d-461f-8153-d111a4350f3b', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:20,608 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1582 0.036)
gunicorn-web stdout | 2024-04-22 04:07:20,609 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:07:21,045 [281] [DEBUG] [app] Starting request: urn:request:da10ef54-b0ee-46ee-9d24-41b90658170b (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:21,045 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,046 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,046 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,055 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,058 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,064 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,065 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,067 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:07:21,070 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:07:21,073 [281] [DEBUG] [app] Ending request: urn:request:da10ef54-b0ee-46ee-9d24-41b90658170b (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:da10ef54-b0ee-46ee-9d24-41b90658170b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,073 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1558 0.029)
gunicorn-web stdout | 2024-04-22 04:07:21,073 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:02.556208+00:00 (in 40.999800 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:21 UTC)" (scheduled at 2024-04-22 04:07:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,566 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), True, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,569 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), True, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,571 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:21 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,650 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:07:21,754 [282] [DEBUG] [app] Starting request: urn:request:1176ac2c-067d-4b92-b483-d53efd3d2ac0 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:21,754 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,754 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,755 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,767 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,773 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,774 [282] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:07:21,777 [282] [DEBUG] [app] Ending request: urn:request:1176ac2c-067d-4b92-b483-d53efd3d2ac0 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:1176ac2c-067d-4b92-b483-d53efd3d2ac0', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,777 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:21,777 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [app] Starting request: urn:request:6741fdf1-6ce3-4457-8065-0fcf8c37ebe9 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,796 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,799 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,805 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,806 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,809 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:07:21,812 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,814 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,817 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,819 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,821 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,823 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,825 [282] [DEBUG] [app] Ending request: urn:request:6741fdf1-6ce3-4457-8065-0fcf8c37ebe9 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:6741fdf1-6ce3-4457-8065-0fcf8c37ebe9', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,825 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:21,826 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 875 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 875 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1535 0.039)
gunicorn-web stdout | 2024-04-22 04:07:21,919 [278] [DEBUG] [app] Starting request: urn:request:bde9f094-71c8-4ce2-9e8e-d551ae87b98e (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:21,919 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,919 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,920 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,931 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,937 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,939 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,943 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:07:21,947 [278] [DEBUG] [app] Ending request: urn:request:bde9f094-71c8-4ce2-9e8e-d551ae87b98e (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:bde9f094-71c8-4ce2-9e8e-d551ae87b98e', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,948 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:21,948 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:38.058708+00:00 (in 15.999193 seconds)
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:22 UTC)" (scheduled at 2024-04-22 04:07:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:33.759375+00:00 (in 9.999482 seconds)
notificationworker stdout | 2024-04-22 04:07:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:33 UTC)" (scheduled at 2024-04-22 04:07:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 23, 760308), True, datetime.datetime(2024, 4, 22, 4, 7, 23, 760308), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:24 UTC)" (scheduled at 2024-04-22 04:07:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:07:25,293 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:07:26,316 [281] [DEBUG] [app] Starting request: urn:request:e8a17dcd-bd15-4679-b5af-0dbdf06c5cbd (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:26,316 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,316 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,317 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,327 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,327 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,329 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:26,335 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,335 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:26,336 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:26,338 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:26,341 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:07:26,343 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,343 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,343 [281] [DEBUG] [app] Ending request: urn:request:e8a17dcd-bd15-4679-b5af-0dbdf06c5cbd (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:e8a17dcd-bd15-4679-b5af-0dbdf06c5cbd', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:26,344 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:26,344 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:26 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:26 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1565 0.029)
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:35.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 04:07:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:56 UTC)" (scheduled at 2024-04-22 04:07:26.873109+00:00)
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:07:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:07:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 2, 26, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:07:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 2, 26, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:07:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:07:27,046 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:07:28,242 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:07:28,381 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:07:30,120 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:07:30,127 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:07:30,138 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:07:30,141 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:07:30,144 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:07:30,308 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:07:30,405 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:07:30,653 [279] [DEBUG] [app] Starting request: urn:request:e1657700-9172-43d8-84b6-d386dac76220 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:30,653 [278] [DEBUG] [app] Starting request: urn:request:01c5fac3-bc78-483b-9777-dfb5942f0ba0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:30,656 [284] [DEBUG] [app] Starting request: urn:request:bd5c4817-900a-43c6-886b-03b81698c993 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:30,656 [292] [DEBUG] [app] Starting request: urn:request:431de344-9337-45bc-b086-969a04a74620 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:30,656 [284] [DEBUG] [app] Ending request: urn:request:bd5c4817-900a-43c6-886b-03b81698c993 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bd5c4817-900a-43c6-886b-03b81698c993', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:30,657 [292] [DEBUG] [app] Ending request: urn:request:431de344-9337-45bc-b086-969a04a74620 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:431de344-9337-45bc-b086-969a04a74620', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:07:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:30,659 [279] [DEBUG] [app] Starting request: urn:request:e869c6d3-bd62-4709-b5b4-c2976b3e6857 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:30,659 [281] [DEBUG] [app] Starting request: urn:request:a14d6e68-4813-40a8-9a7c-2cf49db8f5bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:30,660 [279] [DEBUG] [app] Ending request: urn:request:e869c6d3-bd62-4709-b5b4-c2976b3e6857 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e869c6d3-bd62-4709-b5b4-c2976b3e6857', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:30,660 [281] [DEBUG] [app] Ending request: urn:request:a14d6e68-4813-40a8-9a7c-2cf49db8f5bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a14d6e68-4813-40a8-9a7c-2cf49db8f5bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:30,674 [278] [DEBUG] [app] Ending request: urn:request:01c5fac3-bc78-483b-9777-dfb5942f0ba0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:01c5fac3-bc78-483b-9777-dfb5942f0ba0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:30,674 [279] [DEBUG] [app] Ending request: urn:request:e1657700-9172-43d8-84b6-d386dac76220 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e1657700-9172-43d8-84b6-d386dac76220', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:07:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:07:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:46.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:07:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:46 UTC)" (scheduled at 2024-04-22 04:07:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:07:31,285 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:07:32,825 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:07:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:43.759375+00:00 (in 9.999432 seconds)
notificationworker stdout | 2024-04-22 04:07:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:43 UTC)" (scheduled at 2024-04-22 04:07:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 33, 760429), True, datetime.datetime(2024, 4, 22, 4, 7, 33, 760429), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:07:34,185 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:07:34,436 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:07:34,660 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:07:34,720 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:07:34,724 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:07:34,728 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:07:35,715 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:56.873109+00:00 (in 21.000741 seconds)
securityworker stdout | 2024-04-22 04:07:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:05 UTC)" (scheduled at 2024-04-22 04:07:35.871852+00:00)
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:07:36,905 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:07:36,956 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:07:37,081 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
namespacegcworker stdout | 2024-04-22 04:07:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:07:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:43.057186+00:00 (in 4.998007 seconds)
namespacegcworker stdout | 2024-04-22 04:07:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:38 UTC)" (scheduled at 2024-04-22 04:07:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:07:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:07:38,069 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), True, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:07:38,071 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), True, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:07:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:07:38,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:38 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:07:38,150 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:07:39,438 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:07:39,466 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:41.564959+00:00 (in 1.997489 seconds)
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:39 UTC)" (scheduled at 2024-04-22 04:07:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:07:39,814 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:07:39,889 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:07:41,030 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:07:41,033 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:07:41,044 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:07:41,046 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:07:41,050 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:07:41,053 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:07:41,055 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:07:41,058 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:07:41,061 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:07:41,206 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:07:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:07:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:11.264267+00:00 (in 29.999468 seconds)
autopruneworker stdout | 2024-04-22 04:07:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:11 UTC)" (scheduled at 2024-04-22 04:07:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:07:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758801271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:07:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:07:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:07:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:39.566970+00:00 (in 58.001515 seconds)
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:41 UTC)" (scheduled at 2024-04-22 04:07:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:07:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 41, 565723), True, datetime.datetime(2024, 4, 22, 4, 7, 41, 565723), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:07:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:07:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:07:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:07:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:07:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:22.058978+00:00 (in 39.001288 seconds)
namespacegcworker stdout | 2024-04-22 04:07:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:43 UTC)" (scheduled at 2024-04-22 04:07:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:07:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:07:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 43, 58126), True, datetime.datetime(2024, 4, 22, 4, 7, 43, 58126), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:07:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:07:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:07:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:53.759375+00:00 (in 9.999505 seconds)
notificationworker stdout | 2024-04-22 04:07:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:53 UTC)" (scheduled at 2024-04-22 04:07:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 43, 760160), True, datetime.datetime(2024, 4, 22, 4, 7, 43, 760160), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:07:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:07:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:14.952062+00:00 (in 29.999468 seconds)
gcworker stdout | 2024-04-22 04:07:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:14 UTC)" (scheduled at 2024-04-22 04:07:44.952062+00:00)
gcworker stdout | 2024-04-22 04:07:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549264953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:07:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:07:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:07:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:45,653 [282] [DEBUG] [app] Starting request: urn:request:a20f756b-957d-4ff4-9b61-7f321c80bdfb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:45,653 [281] [DEBUG] [app] Starting request: urn:request:85b2a247-9e78-4849-8814-9d6a8df56ea3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:45,656 [292] [DEBUG] [app] Starting request: urn:request:ff10e896-5866-4cfe-a51d-e70f0a6a8041 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:45,656 [290] [DEBUG] [app] Starting request: urn:request:82c14cdd-18b7-4503-a369-2122f3e3fa43 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [292] [DEBUG] [app] Ending request: urn:request:ff10e896-5866-4cfe-a51d-e70f0a6a8041 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ff10e896-5866-4cfe-a51d-e70f0a6a8041', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [290] [DEBUG] [app] Ending request: urn:request:82c14cdd-18b7-4503-a369-2122f3e3fa43 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:82c14cdd-18b7-4503-a369-2122f3e3fa43', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:07:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [DEBUG] [app] Starting request: urn:request:3f765408-42fb-46f7-a811-21ad5b8283c0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [DEBUG] [app] Ending request: urn:request:3f765408-42fb-46f7-a811-21ad5b8283c0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3f765408-42fb-46f7-a811-21ad5b8283c0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:45,660 [279] [DEBUG] [app] Starting request: urn:request:1ab529d7-e499-460a-bdcb-8b319c96d62f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:45,661 [279] [DEBUG] [app] Ending request: urn:request:1ab529d7-e499-460a-bdcb-8b319c96d62f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1ab529d7-e499-460a-bdcb-8b319c96d62f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:45,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:45,674 [281] [DEBUG] [app] Ending request: urn:request:85b2a247-9e78-4849-8814-9d6a8df56ea3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:85b2a247-9e78-4849-8814-9d6a8df56ea3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:45,675 [282] [DEBUG] [app] Ending request: urn:request:a20f756b-957d-4ff4-9b61-7f321c80bdfb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a20f756b-957d-4ff4-9b61-7f321c80bdfb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:07:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:07:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:46,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:01.054492+00:00 (in 14.999538 seconds)
quotatotalworker stdout | 2024-04-22 04:07:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:01 UTC)" (scheduled at 2024-04-22 04:07:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:46,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:07:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:07:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:17.052354+00:00 (in 29.999519 seconds)
buildlogsarchiver stdout | 2024-04-22 04:07:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:17 UTC)" (scheduled at 2024-04-22 04:07:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:07:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 7, 47, 53177), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:07:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:07:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:07:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:07:50,238 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:07:51,668 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:07:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:03.759375+00:00 (in 9.999465 seconds)
notificationworker stdout | 2024-04-22 04:07:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:03 UTC)" (scheduled at 2024-04-22 04:07:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 53, 760369), True, datetime.datetime(2024, 4, 22, 4, 7, 53, 760369), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:07:55,307 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:05.871852+00:00 (in 8.998227 seconds)
securityworker stdout | 2024-04-22 04:07:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:26 UTC)" (scheduled at 2024-04-22 04:07:56.873109+00:00)
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:07:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:07:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 2, 56, 881897), 1, 2])
securityworker stdout | 2024-04-22 04:07:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 2, 56, 881897), 1, 2])
securityworker stdout | 2024-04-22 04:07:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:07:57,083 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:07:58,275 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:07:58,417 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:08:00,131 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:08:00,135 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:08:00,145 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:08:00,152 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:08:00,154 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:08:00,345 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:08:00,433 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:08:00,652 [278] [DEBUG] [app] Starting request: urn:request:59724ff9-b88c-4abc-9287-b0670604aaf5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:00,652 [279] [DEBUG] [app] Starting request: urn:request:d076b50a-c8e0-4b8b-8704-b0a9e024c3a5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:00,655 [290] [DEBUG] [app] Starting request: urn:request:7bfd33d9-c6a1-4d79-917f-6c961d4540a1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:00,655 [284] [DEBUG] [app] Starting request: urn:request:b0a40854-ca48-4778-9c46-75bd757f673e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [284] [DEBUG] [app] Ending request: urn:request:b0a40854-ca48-4778-9c46-75bd757f673e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b0a40854-ca48-4778-9c46-75bd757f673e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [290] [DEBUG] [app] Ending request: urn:request:7bfd33d9-c6a1-4d79-917f-6c961d4540a1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7bfd33d9-c6a1-4d79-917f-6c961d4540a1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:08:00,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:00,657 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:00,659 [279] [DEBUG] [app] Starting request: urn:request:9e2a1484-6ad8-41c0-a15b-1410169b777a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [282] [DEBUG] [app] Starting request: urn:request:f1f161ce-b9e7-4e4f-8a4e-3ce94f7a9aba (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [279] [DEBUG] [app] Ending request: urn:request:9e2a1484-6ad8-41c0-a15b-1410169b777a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9e2a1484-6ad8-41c0-a15b-1410169b777a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [282] [DEBUG] [app] Ending request: urn:request:f1f161ce-b9e7-4e4f-8a4e-3ce94f7a9aba (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f1f161ce-b9e7-4e4f-8a4e-3ce94f7a9aba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:00,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:00,674 [279] [DEBUG] [app] Ending request: urn:request:d076b50a-c8e0-4b8b-8704-b0a9e024c3a5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d076b50a-c8e0-4b8b-8704-b0a9e024c3a5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:00,674 [278] [DEBUG] [app] Ending request: urn:request:59724ff9-b88c-4abc-9287-b0670604aaf5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:59724ff9-b88c-4abc-9287-b0670604aaf5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:08:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:08:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:01,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:16.054492+00:00 (in 14.999556 seconds)
quotatotalworker stdout | 2024-04-22 04:08:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:16 UTC)" (scheduled at 2024-04-22 04:08:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:08:01,305 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:16.552337+00:00 (in 13.995640 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:02 UTC)" (scheduled at 2024-04-22 04:08:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:02,840 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:08:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:13.759375+00:00 (in 9.999436 seconds)
notificationworker stdout | 2024-04-22 04:08:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:13 UTC)" (scheduled at 2024-04-22 04:08:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 3, 760282), True, datetime.datetime(2024, 4, 22, 4, 8, 3, 760282), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:04,222 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:08:04,472 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:08:04,697 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:08:04,727 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:08:04,730 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:08:04,734 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gunicorn-web stdout | 2024-04-22 04:08:04,905 [278] [DEBUG] [app] Starting request: urn:request:7fc4ce3f-647d-4f92-85b2-0635d11387bc (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:08:04,906 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,906 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,906 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,919 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:04,925 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,926 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,930 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,933 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,935 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['slack', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,937 [278] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['37a609f6-18e0-4667-9e99-ed8347122ff4', 1, 5, 5, 'push slack', '{"url": "https://hooks.slack.com/services/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"}', '{}', 0])
gunicorn-web stdout | 2024-04-22 04:08:04,942 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,945 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,947 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 8, 4, 944850), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "37a609f6-18e0-4667-9e99-ed8347122ff4", "event": "repo_push", "method": "slack"}'])
gunicorn-web stdout | 2024-04-22 04:08:04,951 [278] [DEBUG] [app] Ending request: urn:request:7fc4ce3f-647d-4f92-85b2-0635d11387bc (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:7fc4ce3f-647d-4f92-85b2-0635d11387bc', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'slack', 'config': {'url': 'https://hooks.slack.com/services/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'}, 'eventConfig': {}, 'title': 'push slack'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:04,952 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:04,952 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:08:04 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 262 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:08:04 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 262 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 1888 0.048)
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [app] Starting request: urn:request:90bc352a-00fd-462b-8b8d-dddb21a5ff5b (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,298 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:05,304 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,305 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,309 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,311 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,313 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,316 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758885315, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,318 [278] [DEBUG] [app] Ending request: urn:request:90bc352a-00fd-462b-8b8d-dddb21a5ff5b (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:90bc352a-00fd-462b-8b8d-dddb21a5ff5b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:05,319 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:05,319 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:08:05 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:08:05 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1563 0.034)
logrotateworker stdout | 2024-04-22 04:08:05,752 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:26.873109+00:00 (in 21.000748 seconds)
securityworker stdout | 2024-04-22 04:08:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:35 UTC)" (scheduled at 2024-04-22 04:08:05.871852+00:00)
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:05,884 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:35 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:05,997 [278] [DEBUG] [app] Starting request: urn:request:d94c0b17-16dd-481d-bbb9-79acd9c59ca5 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:05,997 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,997 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,998 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,008 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,008 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,010 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:06,016 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,016 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,017 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,019 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,021 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:08:06,023 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,024 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,024 [278] [DEBUG] [app] Ending request: urn:request:d94c0b17-16dd-481d-bbb9-79acd9c59ca5 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:d94c0b17-16dd-481d-bbb9-79acd9c59ca5', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:06,025 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:06,025 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1557 0.029)
gunicorn-web stdout | 2024-04-22 04:08:06,414 [282] [DEBUG] [app] Starting request: urn:request:cd71c323-d6b1-4da8-bb6d-cca32187d9c4 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:06,414 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,414 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,415 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [app] Starting request: urn:request:5322d2c2-e443-48f9-b69b-1abfbdf8de07 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,425 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,425 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,425 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,427 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:06,431 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,434 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,434 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:06,434 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,437 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:08:06,440 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:08:06,440 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,441 [278] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:08:06,442 [282] [DEBUG] [app] Ending request: urn:request:cd71c323-d6b1-4da8-bb6d-cca32187d9c4 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:cd71c323-d6b1-4da8-bb6d-cca32187d9c4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:06,443 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1539 0.030)
gunicorn-web stdout | 2024-04-22 04:08:06,443 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:08:06,443 [278] [DEBUG] [app] Ending request: urn:request:5322d2c2-e443-48f9-b69b-1abfbdf8de07 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:5322d2c2-e443-48f9-b69b-1abfbdf8de07', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:06,444 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:06,444 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1539 0.022)
repositorygcworker stdout | 2024-04-22 04:08:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:08:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:13.555667+00:00 (in 7.002670 seconds)
repositorygcworker stdout | 2024-04-22 04:08:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:06 UTC)" (scheduled at 2024-04-22 04:08:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:08:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:08:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 6, 553443), True, datetime.datetime(2024, 4, 22, 4, 8, 6, 553443), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:08:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:08:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:08:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:08:06,942 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:08:06,993 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:08:07,116 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:08:07,144 [278] [DEBUG] [app] Starting request: urn:request:cd1f2d30-52ab-4dfe-bb11-7d6c49fb7e8e (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:07,144 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,144 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,145 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,156 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:07,162 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,163 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,167 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:08:07,169 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,171 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,174 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,175 [282] [DEBUG] [app] Starting request: urn:request:6e620594-dabd-4903-b0e6-1a9c03c54f1a (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:07,175 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,175 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,176 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,176 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,178 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,180 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,182 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,184 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,186 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,186 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,186 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,186 [278] [DEBUG] [app] Ending request: urn:request:cd1f2d30-52ab-4dfe-bb11-7d6c49fb7e8e (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:cd1f2d30-52ab-4dfe-bb11-7d6c49fb7e8e', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:07,186 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:07,187 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 1138 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 1138 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.044 1535 0.044)
gunicorn-web stdout | 2024-04-22 04:08:07,188 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:07,194 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,195 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,199 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:08:07,203 [282] [DEBUG] [app] Ending request: urn:request:6e620594-dabd-4903-b0e6-1a9c03c54f1a (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:6e620594-dabd-4903-b0e6-1a9c03c54f1a', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:07,203 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:07,204 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
blobuploadcleanupworker stdout | 2024-04-22 04:08:08,157 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:08:09,457 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:08:09,489 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:08:09,827 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:08:09,896 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:08:11,042 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:08:11,045 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:08:11,053 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:08:11,056 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:08:11,061 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:08:11,064 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:08:11,067 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:08:11,070 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:08:11,073 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:08:11,212 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:08:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:08:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:41.264267+00:00 (in 29.999435 seconds)
autopruneworker stdout | 2024-04-22 04:08:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:41 UTC)" (scheduled at 2024-04-22 04:08:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:08:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758831271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:08:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:08:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:08:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:08:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:06.552482+00:00 (in 52.996302 seconds)
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:13 UTC)" (scheduled at 2024-04-22 04:08:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:19.762160+00:00 (in 6.002304 seconds)
notificationworker stdout | 2024-04-22 04:08:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:23 UTC)" (scheduled at 2024-04-22 04:08:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 13, 760279), True, datetime.datetime(2024, 4, 22, 4, 8, 13, 760279), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:08:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:08:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:44.952062+00:00 (in 29.999497 seconds)
gcworker stdout | 2024-04-22 04:08:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:44 UTC)" (scheduled at 2024-04-22 04:08:14.952062+00:00)
gcworker stdout | 2024-04-22 04:08:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549294952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:08:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:08:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:08:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:15,653 [281] [DEBUG] [app] Starting request: urn:request:f50bdfa0-bc0b-49c8-98b0-2d558c6490ed (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:15,653 [278] [DEBUG] [app] Starting request: urn:request:6e231928-7c35-4064-bc4f-f72117145688 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [284] [DEBUG] [app] Starting request: urn:request:b17fd400-8e35-469b-8cac-d53dcf90c525 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [289] [DEBUG] [app] Starting request: urn:request:43a59532-ed1a-49b8-b349-cc92e4ef42ec (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [284] [DEBUG] [app] Ending request: urn:request:b17fd400-8e35-469b-8cac-d53dcf90c525 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b17fd400-8e35-469b-8cac-d53dcf90c525', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [289] [DEBUG] [app] Ending request: urn:request:43a59532-ed1a-49b8-b349-cc92e4ef42ec (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43a59532-ed1a-49b8-b349-cc92e4ef42ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:08:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:15,659 [278] [DEBUG] [app] Starting request: urn:request:3cec2523-678d-4f70-aad0-08335ae8d7bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:15,659 [278] [DEBUG] [app] Ending request: urn:request:3cec2523-678d-4f70-aad0-08335ae8d7bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3cec2523-678d-4f70-aad0-08335ae8d7bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:15,659 [282] [DEBUG] [app] Starting request: urn:request:d187fd33-4a0e-46f0-8814-158983f2d158 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:15,660 [282] [DEBUG] [app] Ending request: urn:request:d187fd33-4a0e-46f0-8814-158983f2d158 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d187fd33-4a0e-46f0-8814-158983f2d158', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:15,673 [281] [DEBUG] [app] Ending request: urn:request:f50bdfa0-bc0b-49c8-98b0-2d558c6490ed (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f50bdfa0-bc0b-49c8-98b0-2d558c6490ed', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:08:15,674 [278] [DEBUG] [app] Ending request: urn:request:6e231928-7c35-4064-bc4f-f72117145688 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6e231928-7c35-4064-bc4f-f72117145688', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:08:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:08:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:31.054492+00:00 (in 14.999488 seconds)
quotatotalworker stdout | 2024-04-22 04:08:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:31 UTC)" (scheduled at 2024-04-22 04:08:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:02.556208+00:00 (in 46.003341 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:16 UTC)" (scheduled at 2024-04-22 04:08:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 16, 553307), True, datetime.datetime(2024, 4, 22, 4, 8, 16, 553307), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:08:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:47.052354+00:00 (in 29.999484 seconds)
buildlogsarchiver stdout | 2024-04-22 04:08:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:47 UTC)" (scheduled at 2024-04-22 04:08:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:08:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 8, 17, 53221), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:08:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:08:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:08:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:23.759375+00:00 (in 3.996659 seconds)
notificationworker stdout | 2024-04-22 04:08:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:13:19 UTC)" (scheduled at 2024-04-22 04:08:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:08:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 'notification/%'])
notificationworker stdout | 2024-04-22 04:08:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:19 UTC)" (scheduled at 2024-04-22 04:08:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:08:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:08:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:19,772 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), True, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:08:19,775 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), True, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 'notification/%'])
notificationworker stdout | 2024-04-22 04:08:19,777 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:19,777 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:13:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:08:20,274 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:08:21,678 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:43.057186+00:00 (in 20.997661 seconds)
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:22 UTC)" (scheduled at 2024-04-22 04:08:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:08:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:22 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:22,221 [278] [DEBUG] [app] Starting request: urn:request:d4df9396-a86f-4a45-b880-5af285632d2f (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:22,221 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,221 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,222 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,233 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,235 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:22,241 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,242 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:22,243 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:22,245 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:22,248 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:08:22,250 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,250 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,250 [278] [DEBUG] [app] Ending request: urn:request:d4df9396-a86f-4a45-b880-5af285632d2f (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:d4df9396-a86f-4a45-b880-5af285632d2f', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:22,251 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:22,251 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:22 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:22 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1565 0.031)
notificationworker stdout | 2024-04-22 04:08:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:33.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:08:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:33 UTC)" (scheduled at 2024-04-22 04:08:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 23, 760450), True, datetime.datetime(2024, 4, 22, 4, 8, 23, 760450), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:24.361582+00:00 (in 59.999458 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:24 UTC)" (scheduled at 2024-04-22 04:08:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:08:25,343 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:08:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:35.871852+00:00 (in 8.998284 seconds)
securityworker stdout | 2024-04-22 04:08:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:56 UTC)" (scheduled at 2024-04-22 04:08:26.873109+00:00)
securityworker stdout | 2024-04-22 04:08:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:08:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:08:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 3, 26, 882137), 1, 2])
securityworker stdout | 2024-04-22 04:08:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 3, 26, 882137), 1, 2])
securityworker stdout | 2024-04-22 04:08:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:08:27,113 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:08:28,311 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:08:28,448 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:08:30,144 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:08:30,147 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:08:30,152 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:08:30,162 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:08:30,165 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:08:30,363 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:08:30,448 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:08:30,653 [278] [DEBUG] [app] Starting request: urn:request:d4daf703-1db9-4e3c-a115-94cb61939a18 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:30,653 [279] [DEBUG] [app] Starting request: urn:request:cb664fea-82fc-48d3-b044-da0295b18ce3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:30,656 [284] [DEBUG] [app] Starting request: urn:request:eeb61b98-6f15-4854-86cd-b7659fe732e0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:30,656 [292] [DEBUG] [app] Starting request: urn:request:77fc0d33-f24d-44ac-b6db-1805ecf7a477 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [284] [DEBUG] [app] Ending request: urn:request:eeb61b98-6f15-4854-86cd-b7659fe732e0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eeb61b98-6f15-4854-86cd-b7659fe732e0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [292] [DEBUG] [app] Ending request: urn:request:77fc0d33-f24d-44ac-b6db-1805ecf7a477 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:77fc0d33-f24d-44ac-b6db-1805ecf7a477', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:08:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:30,659 [279] [DEBUG] [app] Starting request: urn:request:7b0f839b-aadc-4e8f-b837-ada9014ea8ad (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [DEBUG] [app] Ending request: urn:request:7b0f839b-aadc-4e8f-b837-ada9014ea8ad (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7b0f839b-aadc-4e8f-b837-ada9014ea8ad', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:30,660 [281] [DEBUG] [app] Starting request: urn:request:4f260944-a9c1-4654-bf01-7ba11930cdc2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:30,661 [281] [DEBUG] [app] Ending request: urn:request:4f260944-a9c1-4654-bf01-7ba11930cdc2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4f260944-a9c1-4654-bf01-7ba11930cdc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:30,674 [279] [DEBUG] [app] Ending request: urn:request:cb664fea-82fc-48d3-b044-da0295b18ce3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cb664fea-82fc-48d3-b044-da0295b18ce3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:08:30,675 [278] [DEBUG] [app] Ending request: urn:request:d4daf703-1db9-4e3c-a115-94cb61939a18 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d4daf703-1db9-4e3c-a115-94cb61939a18', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:08:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:08:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:46.054492+00:00 (in 14.999522 seconds)
quotatotalworker stdout | 2024-04-22 04:08:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:46 UTC)" (scheduled at 2024-04-22 04:08:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:08:31,315 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:08:32,865 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:08:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:43.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 04:08:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:43 UTC)" (scheduled at 2024-04-22 04:08:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 33, 760321), True, datetime.datetime(2024, 4, 22, 4, 8, 33, 760321), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:34,256 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:08:34,508 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:08:34,735 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:08:34,738 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:08:34,741 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:08:34,744 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:08:35,788 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:56.873109+00:00 (in 21.000732 seconds)
securityworker stdout | 2024-04-22 04:08:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:05 UTC)" (scheduled at 2024-04-22 04:08:35.871852+00:00)
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:08:36,976 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:08:37,023 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:08:37,147 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:08:38,171 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:08:39,492 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:08:39,511 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:41.564959+00:00 (in 1.997511 seconds)
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:39 UTC)" (scheduled at 2024-04-22 04:08:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:08:39,856 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:08:39,932 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:08:41,053 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:08:41,056 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:08:41,062 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:08:41,065 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:08:41,071 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:08:41,074 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:08:41,077 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:08:41,080 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:08:41,083 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:08:41,248 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:08:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:08:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:11.264267+00:00 (in 29.999516 seconds)
autopruneworker stdout | 2024-04-22 04:08:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:11 UTC)" (scheduled at 2024-04-22 04:08:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:08:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758861271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:08:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:08:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:08:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:39.566970+00:00 (in 58.001498 seconds)
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:41 UTC)" (scheduled at 2024-04-22 04:08:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:08:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 41, 565746), True, datetime.datetime(2024, 4, 22, 4, 8, 41, 565746), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:08:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:08:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:08:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:08:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:08:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:22.058978+00:00 (in 39.001259 seconds)
namespacegcworker stdout | 2024-04-22 04:08:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:43 UTC)" (scheduled at 2024-04-22 04:08:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:08:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:08:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 43, 58170), True, datetime.datetime(2024, 4, 22, 4, 8, 43, 58170), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:08:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:08:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:08:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:53.759375+00:00 (in 9.999522 seconds)
notificationworker stdout | 2024-04-22 04:08:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:53 UTC)" (scheduled at 2024-04-22 04:08:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 43, 760295), True, datetime.datetime(2024, 4, 22, 4, 8, 43, 760295), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:08:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:08:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:14.952062+00:00 (in 29.999492 seconds)
gcworker stdout | 2024-04-22 04:08:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:14 UTC)" (scheduled at 2024-04-22 04:08:44.952062+00:00)
gcworker stdout | 2024-04-22 04:08:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549324952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:08:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:08:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:08:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:45,653 [282] [DEBUG] [app] Starting request: urn:request:dc54f5dd-e48c-4875-9df1-7ccc1d9616d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:45,653 [281] [DEBUG] [app] Starting request: urn:request:10e7d6b8-f74b-4d32-bab4-bbc0a9b3cfa4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [289] [DEBUG] [app] Starting request: urn:request:941b1411-3e9d-4996-bdd7-7905a1ce44a7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [292] [DEBUG] [app] Starting request: urn:request:e42ee474-3ca0-48f9-a9e7-c65d31c51061 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [292] [DEBUG] [app] Ending request: urn:request:e42ee474-3ca0-48f9-a9e7-c65d31c51061 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e42ee474-3ca0-48f9-a9e7-c65d31c51061', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [289] [DEBUG] [app] Ending request: urn:request:941b1411-3e9d-4996-bdd7-7905a1ce44a7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:941b1411-3e9d-4996-bdd7-7905a1ce44a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:08:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:45,660 [278] [DEBUG] [app] Starting request: urn:request:b041406e-0a71-4e0d-93cf-55874c670a4a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [279] [DEBUG] [app] Starting request: urn:request:fe613226-4c9f-4c32-8c96-1f3939f07fd5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [278] [DEBUG] [app] Ending request: urn:request:b041406e-0a71-4e0d-93cf-55874c670a4a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b041406e-0a71-4e0d-93cf-55874c670a4a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [279] [DEBUG] [app] Ending request: urn:request:fe613226-4c9f-4c32-8c96-1f3939f07fd5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fe613226-4c9f-4c32-8c96-1f3939f07fd5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:45,675 [282] [DEBUG] [app] Ending request: urn:request:dc54f5dd-e48c-4875-9df1-7ccc1d9616d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:dc54f5dd-e48c-4875-9df1-7ccc1d9616d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:08:45,676 [281] [DEBUG] [app] Ending request: urn:request:10e7d6b8-f74b-4d32-bab4-bbc0a9b3cfa4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:10e7d6b8-f74b-4d32-bab4-bbc0a9b3cfa4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:45,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:45,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:08:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:01.054492+00:00 (in 14.999490 seconds)
quotatotalworker stdout | 2024-04-22 04:08:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:01 UTC)" (scheduled at 2024-04-22 04:08:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:08:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:17.052354+00:00 (in 29.999466 seconds)
buildlogsarchiver stdout | 2024-04-22 04:08:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:17 UTC)" (scheduled at 2024-04-22 04:08:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:08:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 8, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:08:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:08:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:08:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:08:50,291 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:08:51,698 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:08:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:03.759375+00:00 (in 9.999484 seconds)
notificationworker stdout | 2024-04-22 04:08:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:03 UTC)" (scheduled at 2024-04-22 04:08:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 53, 760326), True, datetime.datetime(2024, 4, 22, 4, 8, 53, 760326), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:08:55,380 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:08:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:05.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:08:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:26 UTC)" (scheduled at 2024-04-22 04:08:56.873109+00:00)
securityworker stdout | 2024-04-22 04:08:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:08:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:08:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 3, 56, 880903), 1, 2])
securityworker stdout | 2024-04-22 04:08:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 3, 56, 880903), 1, 2])
securityworker stdout | 2024-04-22 04:08:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:08:57,137 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:08:58,320 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:08:58,455 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:09:00,155 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:09:00,158 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:09:00,160 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:09:00,174 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:09:00,177 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:09:00,371 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:09:00,481 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:09:00,652 [278] [DEBUG] [app] Starting request: urn:request:d6753470-97d0-460c-ba5d-d7c4d0fc2e64 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:00,653 [279] [DEBUG] [app] Starting request: urn:request:cc688136-6941-4d82-8455-a31edd9fa3ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [284] [DEBUG] [app] Starting request: urn:request:61667dc4-f703-4ff8-8720-133d44605f66 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [291] [DEBUG] [app] Starting request: urn:request:7cff7e18-ebf7-48cd-97c7-d4118bf1d231 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [291] [DEBUG] [app] Ending request: urn:request:7cff7e18-ebf7-48cd-97c7-d4118bf1d231 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7cff7e18-ebf7-48cd-97c7-d4118bf1d231', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [284] [DEBUG] [app] Ending request: urn:request:61667dc4-f703-4ff8-8720-133d44605f66 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61667dc4-f703-4ff8-8720-133d44605f66', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:09:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:00,659 [279] [DEBUG] [app] Starting request: urn:request:9c66f672-c504-4840-ab6a-f9d715a37a66 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:00,659 [279] [DEBUG] [app] Ending request: urn:request:9c66f672-c504-4840-ab6a-f9d715a37a66 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9c66f672-c504-4840-ab6a-f9d715a37a66', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:00,660 [282] [DEBUG] [app] Starting request: urn:request:18375ab2-eaf8-4c1f-abc6-d3ee0bc3e1f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:00,661 [282] [DEBUG] [app] Ending request: urn:request:18375ab2-eaf8-4c1f-abc6-d3ee0bc3e1f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:18375ab2-eaf8-4c1f-abc6-d3ee0bc3e1f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:00,674 [279] [DEBUG] [app] Ending request: urn:request:cc688136-6941-4d82-8455-a31edd9fa3ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cc688136-6941-4d82-8455-a31edd9fa3ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:09:00,675 [278] [DEBUG] [app] Ending request: urn:request:d6753470-97d0-460c-ba5d-d7c4d0fc2e64 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d6753470-97d0-460c-ba5d-d7c4d0fc2e64', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:09:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:09:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:16.054492+00:00 (in 14.999490 seconds)
quotatotalworker stdout | 2024-04-22 04:09:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:16 UTC)" (scheduled at 2024-04-22 04:09:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:09:01,342 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:16.552337+00:00 (in 13.995608 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:02 UTC)" (scheduled at 2024-04-22 04:09:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:09:02,875 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:09:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:13.759375+00:00 (in 9.999414 seconds)
notificationworker stdout | 2024-04-22 04:09:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:13 UTC)" (scheduled at 2024-04-22 04:09:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 3, 760389), True, datetime.datetime(2024, 4, 22, 4, 9, 3, 760389), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:09:04,270 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:09:04,533 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:09:04,747 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:09:04,750 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
exportactionlogsworker stdout | 2024-04-22 04:09:04,752 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:09:04,755 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:09:05,816 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:26.873109+00:00 (in 21.000745 seconds)
securityworker stdout | 2024-04-22 04:09:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:35 UTC)" (scheduled at 2024-04-22 04:09:05.871852+00:00)
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:09:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:09:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:13.555667+00:00 (in 7.002659 seconds)
repositorygcworker stdout | 2024-04-22 04:09:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:06 UTC)" (scheduled at 2024-04-22 04:09:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:09:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:09:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 6, 553405), True, datetime.datetime(2024, 4, 22, 4, 9, 6, 553405), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:09:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:09:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:09:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:09:07,014 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:09:07,031 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:09:07,183 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:09:07,308 [282] [DEBUG] [app] Starting request: urn:request:3a4a6381-c6ca-4698-8d96-bda44ef71ba9 (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:07,309 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,309 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,309 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,319 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:07,319 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:07,319 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,320 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,323 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:09:07,328 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:09:07,330 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:09:07,332 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:09:07,337 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,339 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:09:07,341 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,343 [282] [DEBUG] [app] Ending request: urn:request:3a4a6381-c6ca-4698-8d96-bda44ef71ba9 (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:3a4a6381-c6ca-4698-8d96-bda44ef71ba9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:07,344 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:07,344 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:07 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:07 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.037 1523 0.037)
blobuploadcleanupworker stdout | 2024-04-22 04:09:08,181 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:09:09,528 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:09:09,535 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:09:09,892 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:09:09,953 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:09:11,063 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:09:11,067 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:09:11,072 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:09:11,075 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:09:11,080 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:09:11,083 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:09:11,085 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:09:11,088 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:09:11,091 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:09:11,260 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:09:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:09:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:41.264267+00:00 (in 29.999544 seconds)
autopruneworker stdout | 2024-04-22 04:09:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:41 UTC)" (scheduled at 2024-04-22 04:09:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:09:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758891271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:09:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:09:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:09:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:09:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:06.552482+00:00 (in 52.996380 seconds)
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:13 UTC)" (scheduled at 2024-04-22 04:09:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:09:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:19.762424+00:00 (in 6.002573 seconds)
notificationworker stdout | 2024-04-22 04:09:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:23 UTC)" (scheduled at 2024-04-22 04:09:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 13, 760239), True, datetime.datetime(2024, 4, 22, 4, 9, 13, 760239), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:09:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:09:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:44.952062+00:00 (in 29.999474 seconds)
gcworker stdout | 2024-04-22 04:09:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:44 UTC)" (scheduled at 2024-04-22 04:09:14.952062+00:00)
gcworker stdout | 2024-04-22 04:09:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549354953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:09:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:09:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:09:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:15,653 [278] [DEBUG] [app] Starting request: urn:request:b5e19d58-f693-4ded-b625-7d0f680cd7c3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:15,653 [279] [DEBUG] [app] Starting request: urn:request:c8215f98-7d42-4112-8485-4a6ad16d140b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [292] [DEBUG] [app] Starting request: urn:request:da63bb4a-33e1-4118-a09e-c2902fc51ed5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [284] [DEBUG] [app] Starting request: urn:request:1452be35-6b2d-4d63-aa70-cfae8cb2dc3a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [292] [DEBUG] [app] Ending request: urn:request:da63bb4a-33e1-4118-a09e-c2902fc51ed5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:da63bb4a-33e1-4118-a09e-c2902fc51ed5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [284] [DEBUG] [app] Ending request: urn:request:1452be35-6b2d-4d63-aa70-cfae8cb2dc3a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1452be35-6b2d-4d63-aa70-cfae8cb2dc3a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:09:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:15,659 [278] [DEBUG] [app] Starting request: urn:request:d4cc765e-9250-4107-bba0-dc2ab7525a35 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:15,659 [278] [DEBUG] [app] Ending request: urn:request:d4cc765e-9250-4107-bba0-dc2ab7525a35 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d4cc765e-9250-4107-bba0-dc2ab7525a35', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:15,659 [282] [DEBUG] [app] Starting request: urn:request:8654a77c-f4cb-4582-9b2f-29ea2ab40eb1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:15,660 [282] [DEBUG] [app] Ending request: urn:request:8654a77c-f4cb-4582-9b2f-29ea2ab40eb1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8654a77c-f4cb-4582-9b2f-29ea2ab40eb1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:15,673 [279] [DEBUG] [app] Ending request: urn:request:c8215f98-7d42-4112-8485-4a6ad16d140b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c8215f98-7d42-4112-8485-4a6ad16d140b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:15,674 [278] [DEBUG] [app] Ending request: urn:request:b5e19d58-f693-4ded-b625-7d0f680cd7c3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5e19d58-f693-4ded-b625-7d0f680cd7c3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:09:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:09:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:31.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:09:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:31 UTC)" (scheduled at 2024-04-22 04:09:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:02.556208+00:00 (in 46.003278 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:16 UTC)" (scheduled at 2024-04-22 04:09:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 16, 553330), True, datetime.datetime(2024, 4, 22, 4, 9, 16, 553330), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:09:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:09:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:47.052354+00:00 (in 29.999465 seconds)
buildlogsarchiver stdout | 2024-04-22 04:09:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:47 UTC)" (scheduled at 2024-04-22 04:09:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:09:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 9, 17, 53255), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:09:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:09:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:09:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:17,336 [281] [DEBUG] [app] Starting request: urn:request:384ea4f7-45f3-4d01-a1d0-308e0d0d86a8 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:17,336 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,336 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,337 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,345 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:17,345 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:17,345 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,348 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:17,354 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,355 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,359 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:17,361 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,364 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,366 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['quay_notification', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,368 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 6, 4, 'vul quay', '{"target": {"name": "owners", "kind": "team", "is_robot": false, "avatar": {"name": "owners", "hash": "6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90", "color": "#c7c7c7", "kind": "team"}, "is_org_member": true}}', '{"level": "2"}', 0])
gunicorn-web stdout | 2024-04-22 04:09:17,373 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,375 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,378 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 9, 17, 375488), '10.131.0.9', '{"repo": "pushno", "namespace": "build_test", "notification_id": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event": "vulnerability_found", "method": "quay_notification"}'])
gunicorn-web stdout | 2024-04-22 04:09:17,382 [281] [DEBUG] [app] Ending request: urn:request:384ea4f7-45f3-4d01-a1d0-308e0d0d86a8 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:384ea4f7-45f3-4d01-a1d0-308e0d0d86a8', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'quay_notification', 'config': {'target': {'name': 'owners', 'kind': 'team', 'is_robot': False, 'avatar': {'name': 'owners', 'hash': '6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90', 'color': '#c7c7c7', 'kind': 'team'}, 'is_org_member': True}}, 'eventConfig': {'level': '2'}, 'title': 'vul quay'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:17,382 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:17,382 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:17 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:17 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 2041 0.048)
gunicorn-web stdout | 2024-04-22 04:09:17,806 [278] [DEBUG] [app] Starting request: urn:request:eb0036c7-1818-4a9d-a7ff-feb839a399ea (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:17,806 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,807 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,807 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,819 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:17,825 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,826 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,830 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,832 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,834 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,837 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758957836, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,840 [278] [DEBUG] [app] Ending request: urn:request:eb0036c7-1818-4a9d-a7ff-feb839a399ea (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:eb0036c7-1818-4a9d-a7ff-feb839a399ea', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:17,840 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:17,840 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:17 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:17 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1563 0.035)
gunicorn-web stdout | 2024-04-22 04:09:18,507 [281] [DEBUG] [app] Starting request: urn:request:43d01687-a069-48a1-9ad4-2d8067336bf5 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:18,507 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,507 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,508 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,520 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:18,527 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,527 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,527 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,530 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,532 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:18,534 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,534 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,535 [281] [DEBUG] [app] Ending request: urn:request:43d01687-a069-48a1-9ad4-2d8067336bf5 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:43d01687-a069-48a1-9ad4-2d8067336bf5', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:18,535 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:18,536 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1557 0.030)
gunicorn-web stdout | 2024-04-22 04:09:18,948 [278] [DEBUG] [app] Starting request: urn:request:087174db-a320-4f7f-a970-cbdfe97cbeaa (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:18,948 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,949 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,949 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,952 [281] [DEBUG] [app] Starting request: urn:request:2a841d22-0d60-410b-93d4-fa41b02a1279 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:18,952 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,952 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,953 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,960 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,962 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,962 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,962 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,964 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:18,966 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,967 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,970 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,970 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:18,970 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:18,972 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:09:18,973 [281] [DEBUG] [app] Ending request: urn:request:2a841d22-0d60-410b-93d4-fa41b02a1279 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:2a841d22-0d60-410b-93d4-fa41b02a1279', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:18,973 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:18,973 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1539 0.022)
gunicorn-web stdout | 2024-04-22 04:09:18,975 [278] [DEBUG] [app] Ending request: urn:request:087174db-a320-4f7f-a970-cbdfe97cbeaa (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:087174db-a320-4f7f-a970-cbdfe97cbeaa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:18,975 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1539 0.029)
gunicorn-web stdout | 2024-04-22 04:09:18,976 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:09:19,677 [278] [DEBUG] [app] Starting request: urn:request:a50beef2-ea8f-4458-8231-5ece2074ba95 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:19,677 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,677 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,678 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,690 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:19,696 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,697 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,700 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:19,703 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,705 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,707 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,709 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,711 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,712 [281] [DEBUG] [app] Starting request: urn:request:96836e38-ecf7-4c58-8ad8-89c3b321e586 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:19,712 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,712 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,713 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,713 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,715 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,717 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,719 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,721 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,721 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,723 [278] [DEBUG] [app] Ending request: urn:request:a50beef2-ea8f-4458-8231-5ece2074ba95 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:a50beef2-ea8f-4458-8231-5ece2074ba95', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:19,724 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:19,724 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 1571 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 1535 0.048)
gunicorn-web stdout | 2024-04-22 04:09:19,724 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 1571 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:09:19,730 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,731 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,736 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:09:19,740 [281] [DEBUG] [app] Ending request: urn:request:96836e38-ecf7-4c58-8ad8-89c3b321e586 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:96836e38-ecf7-4c58-8ad8-89c3b321e586', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:19,740 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:19,740 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
notificationworker stdout | 2024-04-22 04:09:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:23.759375+00:00 (in 3.996484 seconds)
notificationworker stdout | 2024-04-22 04:09:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:19 UTC)" (scheduled at 2024-04-22 04:09:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:09:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:09:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:09:20,328 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:09:21,058 [278] [DEBUG] [app] Starting request: urn:request:107d7b1a-f276-4027-8da2-0c95a34c91b9 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:21,058 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,059 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,059 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:21,068 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,071 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:21,077 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,077 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:21,078 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:21,080 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:21,083 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:21,085 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,085 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,085 [278] [DEBUG] [app] Ending request: urn:request:107d7b1a-f276-4027-8da2-0c95a34c91b9 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:107d7b1a-f276-4027-8da2-0c95a34c91b9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:21,086 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:21,086 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:21 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:21 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1546 0.029)
securityscanningnotificationworker stdout | 2024-04-22 04:09:21,712 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:43.057186+00:00 (in 20.997652 seconds)
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:22 UTC)" (scheduled at 2024-04-22 04:09:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:09:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:33.759375+00:00 (in 9.999475 seconds)
notificationworker stdout | 2024-04-22 04:09:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:33 UTC)" (scheduled at 2024-04-22 04:09:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 23, 760346), True, datetime.datetime(2024, 4, 22, 4, 9, 23, 760346), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:24.361582+00:00 (in 59.999498 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:24 UTC)" (scheduled at 2024-04-22 04:09:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:09:25,390 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:09:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:35.871852+00:00 (in 8.998200 seconds)
securityworker stdout | 2024-04-22 04:09:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:56 UTC)" (scheduled at 2024-04-22 04:09:26.873109+00:00)
securityworker stdout | 2024-04-22 04:09:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:09:26,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:26,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:09:26,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:09:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 4, 26, 880280), 1, 2])
securityworker stdout | 2024-04-22 04:09:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 4, 26, 880280), 1, 2])
securityworker stdout | 2024-04-22 04:09:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:09:27,170 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:09:28,355 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:09:28,463 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:09:30,166 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:09:30,169 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:09:30,172 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:09:30,185 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:09:30,188 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:09:30,400 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:09:30,501 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:09:30,653 [279] [DEBUG] [app] Starting request: urn:request:d1063191-3d7b-48ad-91d5-3c6b866ab41a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:30,653 [281] [DEBUG] [app] Starting request: urn:request:e607aea4-e7c1-4d6b-b706-2cf2d0a1209d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:30,656 [288] [DEBUG] [app] Starting request: urn:request:e8423980-446b-4996-86ed-1d5abab2ebca (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:30,656 [284] [DEBUG] [app] Starting request: urn:request:61856834-f776-41d1-a852-211a33e9c7fe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [288] [DEBUG] [app] Ending request: urn:request:e8423980-446b-4996-86ed-1d5abab2ebca (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e8423980-446b-4996-86ed-1d5abab2ebca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [284] [DEBUG] [app] Ending request: urn:request:61856834-f776-41d1-a852-211a33e9c7fe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61856834-f776-41d1-a852-211a33e9c7fe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:09:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:30,659 [281] [DEBUG] [app] Starting request: urn:request:ff655ce0-9601-480d-b4b2-306d2a63de6f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [278] [DEBUG] [app] Starting request: urn:request:112c51ce-d139-4ff2-8283-68b6c90142f5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [281] [DEBUG] [app] Ending request: urn:request:ff655ce0-9601-480d-b4b2-306d2a63de6f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff655ce0-9601-480d-b4b2-306d2a63de6f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [278] [DEBUG] [app] Ending request: urn:request:112c51ce-d139-4ff2-8283-68b6c90142f5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:112c51ce-d139-4ff2-8283-68b6c90142f5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:30,674 [279] [DEBUG] [app] Ending request: urn:request:d1063191-3d7b-48ad-91d5-3c6b866ab41a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d1063191-3d7b-48ad-91d5-3c6b866ab41a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:30,675 [281] [DEBUG] [app] Ending request: urn:request:e607aea4-e7c1-4d6b-b706-2cf2d0a1209d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e607aea4-e7c1-4d6b-b706-2cf2d0a1209d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:09:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:09:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:46.054492+00:00 (in 14.999469 seconds)
quotatotalworker stdout | 2024-04-22 04:09:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:46 UTC)" (scheduled at 2024-04-22 04:09:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:09:31,376 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:09:32,894 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:09:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:43.759375+00:00 (in 9.999467 seconds)
notificationworker stdout | 2024-04-22 04:09:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:43 UTC)" (scheduled at 2024-04-22 04:09:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 33, 760229), True, datetime.datetime(2024, 4, 22, 4, 9, 33, 760229), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:09:34,281 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:09:34,570 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:09:34,755 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:09:34,759 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:09:34,761 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:09:34,788 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:09:35,834 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:09:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:56.873109+00:00 (in 21.000709 seconds)
securityworker stdout | 2024-04-22 04:09:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:05 UTC)" (scheduled at 2024-04-22 04:09:35.871852+00:00)
securityworker stdout | 2024-04-22 04:09:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:09:37,051 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:09:37,067 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:09:37,220 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:09:38,191 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:09:39,541 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:09:39,557 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:41.564959+00:00 (in 1.997540 seconds)
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:39 UTC)" (scheduled at 2024-04-22 04:09:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:09:39,929 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:09:39,970 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:09:41,074 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:09:41,077 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:09:41,080 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:09:41,082 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:09:41,087 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:09:41,091 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:09:41,095 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:09:41,099 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:09:41,102 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:09:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:09:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:11.264267+00:00 (in 29.999459 seconds)
autopruneworker stdout | 2024-04-22 04:09:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:11 UTC)" (scheduled at 2024-04-22 04:09:41.264267+00:00)
storagereplication stdout | 2024-04-22 04:09:41,270 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:09:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758921271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:09:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:09:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:09:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:39.566970+00:00 (in 58.001503 seconds)
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:41 UTC)" (scheduled at 2024-04-22 04:09:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:09:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 41, 565729), True, datetime.datetime(2024, 4, 22, 4, 9, 41, 565729), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:09:41,575 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:09:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:09:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:42,754 [278] [DEBUG] [app] Starting request: urn:request:7506eb79-393b-436d-8d01-dd52e415fcd4 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:42,754 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,754 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,755 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:42,764 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:42,764 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:42,764 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,767 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:42,773 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,774 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:42,777 [278] [DEBUG] [app] Ending request: urn:request:7506eb79-393b-436d-8d01-dd52e415fcd4 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:7506eb79-393b-436d-8d01-dd52e415fcd4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:42,777 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:42,778 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:42 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:42 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1581 0.025)
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:22.058978+00:00 (in 39.001295 seconds)
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:43 UTC)" (scheduled at 2024-04-22 04:09:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:09:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 43, 58011), True, datetime.datetime(2024, 4, 22, 4, 9, 43, 58011), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:09:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:09:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:09:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:43 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:43,097 [278] [DEBUG] [app] Starting request: urn:request:b2d07fce-21d4-495b-a91d-18af205f6076 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:43,097 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,097 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,098 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,109 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:43,115 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,116 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,121 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,124 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,126 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,128 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['email', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,130 [278] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['821e891b-da3f-4153-b053-c6689eea2a99', 1, 6, 1, 'vul mail', '{"email": "hu_weihua@163.com"}', '{"level": "2"}', 0])
gunicorn-web stdout | 2024-04-22 04:09:43,135 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,138 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,140 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 9, 43, 138220), '10.131.0.9', '{"repo": "pushno", "namespace": "build_test", "notification_id": "821e891b-da3f-4153-b053-c6689eea2a99", "event": "vulnerability_found", "method": "email"}'])
gunicorn-web stdout | 2024-04-22 04:09:43,144 [278] [DEBUG] [app] Ending request: urn:request:b2d07fce-21d4-495b-a91d-18af205f6076 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:b2d07fce-21d4-495b-a91d-18af205f6076', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'email', 'config': {'email': 'hu_weihua@163.com'}, 'eventConfig': {'level': '2'}, 'title': 'vul mail'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:43,145 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:43,145 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:43 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 220 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:43 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 220 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 1864 0.049)
gunicorn-web stdout | 2024-04-22 04:09:43,504 [278] [DEBUG] [app] Starting request: urn:request:e66d1dff-33ba-4425-8be8-be87a1eef0cb (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:43,504 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,504 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,505 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,506 [282] [DEBUG] [app] Starting request: urn:request:6ec9b943-f3d9-401f-ac4b-8066f8a7eff9 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:43,506 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,506 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,507 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,513 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,516 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,517 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,519 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:43,522 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,522 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,523 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,526 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,526 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,527 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,528 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:43,530 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,530 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,531 [278] [DEBUG] [app] Ending request: urn:request:e66d1dff-33ba-4425-8be8-be87a1eef0cb (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:e66d1dff-33ba-4425-8be8-be87a1eef0cb', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:43,531 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,531 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:43,531 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1576 0.028)
gunicorn-web stdout | 2024-04-22 04:09:43,533 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,535 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,538 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758983538, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,541 [282] [DEBUG] [app] Ending request: urn:request:6ec9b943-f3d9-401f-ac4b-8066f8a7eff9 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:6ec9b943-f3d9-401f-ac4b-8066f8a7eff9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:43,542 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1582 0.037)
gunicorn-web stdout | 2024-04-22 04:09:43,542 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
notificationworker stdout | 2024-04-22 04:09:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:53.759375+00:00 (in 9.999513 seconds)
notificationworker stdout | 2024-04-22 04:09:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:53 UTC)" (scheduled at 2024-04-22 04:09:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 43, 760231), True, datetime.datetime(2024, 4, 22, 4, 9, 43, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:53 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:44,640 [278] [DEBUG] [app] Starting request: urn:request:7ff113dc-6518-47d4-acd1-595b64364ec1 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:44,640 [279] [DEBUG] [app] Starting request: urn:request:4e308c1b-239d-4aad-8824-e49851779921 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:44,640 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,640 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,640 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,640 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,641 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,641 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,651 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,653 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,653 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,659 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,660 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,660 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,660 [279] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:44,663 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:44,663 [279] [DEBUG] [app] Ending request: urn:request:4e308c1b-239d-4aad-8824-e49851779921 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:4e308c1b-239d-4aad-8824-e49851779921', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,663 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:44,664 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1539 0.025)
gunicorn-web stdout | 2024-04-22 04:09:44,664 [282] [DEBUG] [app] Starting request: urn:request:746e7afd-934c-49f4-9aff-def58f201312 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:44,665 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,665 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,666 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:09:44,669 [278] [DEBUG] [app] Ending request: urn:request:7ff113dc-6518-47d4-acd1-595b64364ec1 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:7ff113dc-6518-47d4-acd1-595b64364ec1', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,669 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:44,669 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1539 0.030)
gunicorn-web stdout | 2024-04-22 04:09:44,674 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,677 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,683 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,685 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,688 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:44,691 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,693 [278] [DEBUG] [app] Starting request: urn:request:3e141e3e-f757-4eb2-a10c-1e5cdcd1a645 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:44,693 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,693 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,693 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,694 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,696 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,698 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,700 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,702 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,703 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,703 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,704 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,705 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,706 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,708 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,710 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,711 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,712 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,712 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,714 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,716 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:09:44,716 [282] [DEBUG] [app] Ending request: urn:request:746e7afd-934c-49f4-9aff-def58f201312 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:746e7afd-934c-49f4-9aff-def58f201312', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,717 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 1792 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.054 1535 0.054)
gunicorn-web stdout | 2024-04-22 04:09:44,717 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 1792 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:09:44,720 [278] [DEBUG] [app] Ending request: urn:request:3e141e3e-f757-4eb2-a10c-1e5cdcd1a645 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:3e141e3e-f757-4eb2-a10c-1e5cdcd1a645', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,721 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:44,721 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
gcworker stdout | 2024-04-22 04:09:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:09:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:14.952062+00:00 (in 29.999540 seconds)
gcworker stdout | 2024-04-22 04:09:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:14 UTC)" (scheduled at 2024-04-22 04:09:44.952062+00:00)
gcworker stdout | 2024-04-22 04:09:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549384952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:09:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:09:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:09:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:45,653 [278] [DEBUG] [app] Starting request: urn:request:ea61a0c3-ff8d-4c36-8036-405c617e555e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:45,653 [282] [DEBUG] [app] Starting request: urn:request:812d5cc7-f747-4d36-b59b-7f0def6bb722 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:45,656 [292] [DEBUG] [app] Starting request: urn:request:33c266d3-9dc0-4101-98ef-4e040e3d04d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:45,656 [285] [DEBUG] [app] Starting request: urn:request:33e05f9c-d4e7-43da-a0e7-97411d33dc9b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [292] [DEBUG] [app] Ending request: urn:request:33c266d3-9dc0-4101-98ef-4e040e3d04d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:33c266d3-9dc0-4101-98ef-4e040e3d04d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [285] [DEBUG] [app] Ending request: urn:request:33e05f9c-d4e7-43da-a0e7-97411d33dc9b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:33e05f9c-d4e7-43da-a0e7-97411d33dc9b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:09:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:45,660 [282] [DEBUG] [app] Starting request: urn:request:a8395ad7-bb72-4d81-852c-e517a0fc2ec8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [281] [DEBUG] [app] Starting request: urn:request:b45b3685-7f2d-481f-8b08-e1b45b827b8c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [282] [DEBUG] [app] Ending request: urn:request:a8395ad7-bb72-4d81-852c-e517a0fc2ec8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a8395ad7-bb72-4d81-852c-e517a0fc2ec8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [281] [DEBUG] [app] Ending request: urn:request:b45b3685-7f2d-481f-8b08-e1b45b827b8c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b45b3685-7f2d-481f-8b08-e1b45b827b8c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:45,673 [278] [DEBUG] [app] Ending request: urn:request:ea61a0c3-ff8d-4c36-8036-405c617e555e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ea61a0c3-ff8d-4c36-8036-405c617e555e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:45,673 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:09:45,674 [282] [DEBUG] [app] Ending request: urn:request:812d5cc7-f747-4d36-b59b-7f0def6bb722 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:812d5cc7-f747-4d36-b59b-7f0def6bb722', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.021)
gunicorn-web stdout | 2024-04-22 04:09:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.021)
quotatotalworker stdout | 2024-04-22 04:09:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:01.054492+00:00 (in 14.999459 seconds)
quotatotalworker stdout | 2024-04-22 04:09:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:01 UTC)" (scheduled at 2024-04-22 04:09:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:01 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:46,931 [278] [DEBUG] [app] Starting request: urn:request:7d3c8686-ede2-420c-bda2-20ccdaff9276 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:46,931 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,931 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,932 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:46,941 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,945 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:46,951 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,951 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:46,952 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:46,954 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:46,957 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:46,959 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,959 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,959 [278] [DEBUG] [app] Ending request: urn:request:7d3c8686-ede2-420c-bda2-20ccdaff9276 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:7d3c8686-ede2-420c-bda2-20ccdaff9276', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:46,960 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1546 0.030)
gunicorn-web stdout | 2024-04-22 04:09:46,960 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
buildlogsarchiver stdout | 2024-04-22 04:09:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:09:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:17.052354+00:00 (in 29.999523 seconds)
buildlogsarchiver stdout | 2024-04-22 04:09:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:17 UTC)" (scheduled at 2024-04-22 04:09:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:09:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 9, 47, 53163), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:09:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:09:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:09:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:09:50,349 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:09:51,748 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:09:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:03.759375+00:00 (in 9.999434 seconds)
notificationworker stdout | 2024-04-22 04:09:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:03 UTC)" (scheduled at 2024-04-22 04:09:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 53, 760425), True, datetime.datetime(2024, 4, 22, 4, 9, 53, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:09:55,414 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:05.871852+00:00 (in 8.998246 seconds)
securityworker stdout | 2024-04-22 04:09:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:26 UTC)" (scheduled at 2024-04-22 04:09:56.873109+00:00)
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:09:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:09:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:09:56,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:56,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 4, 56, 879421), 1, 2])
securityworker stdout | 2024-04-22 04:09:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 4, 56, 879421), 1, 2])
securityworker stdout | 2024-04-22 04:09:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:56,898 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,898 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:56,898 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:09:57,178 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:09:58,378 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:09:58,498 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:10:00,178 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:10:00,182 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:10:00,184 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:10:00,197 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:10:00,201 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:10:00,438 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:10:00,528 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:10:00,653 [282] [DEBUG] [app] Starting request: urn:request:b2e94667-bc57-43ae-918f-0da5997b634a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:00,653 [281] [DEBUG] [app] Starting request: urn:request:6d2807b0-106a-4eca-90d9-4523353c57ac (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [292] [DEBUG] [app] Starting request: urn:request:423d3ea8-5d24-46ea-b870-74d45c1ff99b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [284] [DEBUG] [app] Starting request: urn:request:38bdc257-f927-45fa-8b11-eb9d8dabd27b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [292] [DEBUG] [app] Ending request: urn:request:423d3ea8-5d24-46ea-b870-74d45c1ff99b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:423d3ea8-5d24-46ea-b870-74d45c1ff99b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [284] [DEBUG] [app] Ending request: urn:request:38bdc257-f927-45fa-8b11-eb9d8dabd27b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:38bdc257-f927-45fa-8b11-eb9d8dabd27b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:10:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:10:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:00,659 [281] [DEBUG] [app] Starting request: urn:request:dc9be8a7-094d-440d-bc17-a92ddd779478 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:00,660 [278] [DEBUG] [app] Starting request: urn:request:f2281f79-a104-4ec0-bcf2-08b0d78823ce (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:00,660 [281] [DEBUG] [app] Ending request: urn:request:dc9be8a7-094d-440d-bc17-a92ddd779478 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dc9be8a7-094d-440d-bc17-a92ddd779478', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:00,660 [278] [DEBUG] [app] Ending request: urn:request:f2281f79-a104-4ec0-bcf2-08b0d78823ce (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f2281f79-a104-4ec0-bcf2-08b0d78823ce', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:10:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:00,674 [282] [DEBUG] [app] Ending request: urn:request:b2e94667-bc57-43ae-918f-0da5997b634a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b2e94667-bc57-43ae-918f-0da5997b634a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:10:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:10:00,675 [281] [DEBUG] [app] Ending request: urn:request:6d2807b0-106a-4eca-90d9-4523353c57ac (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6d2807b0-106a-4eca-90d9-4523353c57ac', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
quotatotalworker stdout | 2024-04-22 04:10:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:16.054492+00:00 (in 14.999450 seconds)
quotatotalworker stdout | 2024-04-22 04:10:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:16 UTC)" (scheduled at 2024-04-22 04:10:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:10:01,393 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:16.552337+00:00 (in 13.995575 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:02 UTC)" (scheduled at 2024-04-22 04:10:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:02,903 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:10:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 04:10:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:13 UTC)" (scheduled at 2024-04-22 04:10:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 3, 760254), True, datetime.datetime(2024, 4, 22, 4, 10, 3, 760254), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:04,312 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:10:04,606 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:10:04,763 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:10:04,767 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:10:04,770 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:10:04,794 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:10:05,870 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:26.873109+00:00 (in 21.000803 seconds)
securityworker stdout | 2024-04-22 04:10:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:35 UTC)" (scheduled at 2024-04-22 04:10:05.871852+00:00)
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:05,890 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:05,892 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:05,892 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:10:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:10:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:13.555667+00:00 (in 7.002730 seconds)
repositorygcworker stdout | 2024-04-22 04:10:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:06 UTC)" (scheduled at 2024-04-22 04:10:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:10:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:10:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 6, 553276), True, datetime.datetime(2024, 4, 22, 4, 10, 6, 553276), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:10:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:10:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:10:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:10:07,087 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:10:07,102 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:10:07,256 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:10:08,201 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:10:09,557 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:10:09,582 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:10:09,964 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:10:09,988 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:10:11,082 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:10:11,087 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:10:11,089 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:10:11,093 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:10:11,096 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:10:11,099 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:10:11,106 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:10:11,109 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:10:11,112 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:10:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:10:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:41.264267+00:00 (in 29.999494 seconds)
autopruneworker stdout | 2024-04-22 04:10:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:41 UTC)" (scheduled at 2024-04-22 04:10:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:10:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758951271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:10:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:10:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:10:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:10:11,306 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:10:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:06.552482+00:00 (in 52.996358 seconds)
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:13 UTC)" (scheduled at 2024-04-22 04:10:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:19.762424+00:00 (in 6.002575 seconds)
notificationworker stdout | 2024-04-22 04:10:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:23 UTC)" (scheduled at 2024-04-22 04:10:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 13, 760276), True, datetime.datetime(2024, 4, 22, 4, 10, 13, 760276), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:10:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:10:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:44.952062+00:00 (in 29.999493 seconds)
gcworker stdout | 2024-04-22 04:10:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:44 UTC)" (scheduled at 2024-04-22 04:10:14.952062+00:00)
gcworker stdout | 2024-04-22 04:10:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549414952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:10:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:10:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:10:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:15,653 [278] [DEBUG] [app] Starting request: urn:request:fe09650c-2acc-4eb1-bb16-75a310870d2b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:15,653 [281] [DEBUG] [app] Starting request: urn:request:e7dba463-904e-4520-af45-a2cb0193737f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [284] [DEBUG] [app] Starting request: urn:request:9fb8efac-7c76-4b59-a152-b083ab5f1332 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [291] [DEBUG] [app] Starting request: urn:request:13a07adf-a723-4789-9ff7-aad862f48959 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [291] [DEBUG] [app] Ending request: urn:request:13a07adf-a723-4789-9ff7-aad862f48959 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:13a07adf-a723-4789-9ff7-aad862f48959', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [284] [DEBUG] [app] Ending request: urn:request:9fb8efac-7c76-4b59-a152-b083ab5f1332 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9fb8efac-7c76-4b59-a152-b083ab5f1332', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:10:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:15,659 [282] [DEBUG] [app] Starting request: urn:request:20fca4dd-1462-470c-a383-fe064afd3a77 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:15,659 [279] [DEBUG] [app] Starting request: urn:request:9f0e100c-7ab6-4697-ba93-b8618bdd7051 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:15,660 [279] [DEBUG] [app] Ending request: urn:request:9f0e100c-7ab6-4697-ba93-b8618bdd7051 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9f0e100c-7ab6-4697-ba93-b8618bdd7051', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:15,660 [282] [DEBUG] [app] Ending request: urn:request:20fca4dd-1462-470c-a383-fe064afd3a77 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:20fca4dd-1462-470c-a383-fe064afd3a77', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:15,673 [281] [DEBUG] [app] Ending request: urn:request:e7dba463-904e-4520-af45-a2cb0193737f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e7dba463-904e-4520-af45-a2cb0193737f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:10:15,674 [278] [DEBUG] [app] Ending request: urn:request:fe09650c-2acc-4eb1-bb16-75a310870d2b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fe09650c-2acc-4eb1-bb16-75a310870d2b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:10:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:10:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:31.054492+00:00 (in 14.999462 seconds)
quotatotalworker stdout | 2024-04-22 04:10:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:31 UTC)" (scheduled at 2024-04-22 04:10:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:02.556208+00:00 (in 46.003281 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:16 UTC)" (scheduled at 2024-04-22 04:10:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 16, 553347), True, datetime.datetime(2024, 4, 22, 4, 10, 16, 553347), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:10:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:47.052354+00:00 (in 29.999492 seconds)
buildlogsarchiver stdout | 2024-04-22 04:10:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:47 UTC)" (scheduled at 2024-04-22 04:10:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:10:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 10, 17, 53275), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:10:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:10:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:10:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:23.759375+00:00 (in 3.996378 seconds)
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:19 UTC)" (scheduled at 2024-04-22 04:10:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:10:20,383 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:10:21,490 [282] [DEBUG] [app] Starting request: urn:request:f3868233-ed0f-4aa0-900a-b2cd6111b592 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:21,491 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,491 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,491 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,500 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:21,500 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,503 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:21,509 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,510 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,514 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,516 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,518 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['webhook', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,520 [282] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 6, 6, 'vul webhook', '{"url": "https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119"}', '{"level": "2"}', 0])
gunicorn-web stdout | 2024-04-22 04:10:21,526 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,528 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,530 [282] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 10, 21, 528172), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "55d1704d-84c4-48e0-a0be-df13625280c4", "event": "vulnerability_found", "method": "webhook"}'])
gunicorn-web stdout | 2024-04-22 04:10:21,534 [282] [DEBUG] [app] Ending request: urn:request:f3868233-ed0f-4aa0-900a-b2cd6111b592 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:f3868233-ed0f-4aa0-900a-b2cd6111b592', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'webhook', 'config': {'url': 'https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119'}, 'eventConfig': {'level': '2'}, 'title': 'vul webhook'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:21,535 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:21,535 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:21 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 263 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:21 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 263 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.047 1888 0.046)
securityscanningnotificationworker stdout | 2024-04-22 04:10:21,785 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:10:21,862 [282] [DEBUG] [app] Starting request: urn:request:5b63fde7-5ae6-47b9-ab21-71cda6accdd1 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:21,862 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,862 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,863 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,871 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:21,871 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:21,871 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,874 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:21,880 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,881 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,885 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,887 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,889 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,892 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713759021892, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,895 [282] [DEBUG] [app] Ending request: urn:request:5b63fde7-5ae6-47b9-ab21-71cda6accdd1 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:5b63fde7-5ae6-47b9-ab21-71cda6accdd1', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:21,896 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:21,896 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:21 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:21 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1563 0.036)
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:43.057186+00:00 (in 20.997697 seconds)
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:22 UTC)" (scheduled at 2024-04-22 04:10:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:22 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:22,583 [282] [DEBUG] [app] Starting request: urn:request:9f11511a-73ba-4329-a818-d2d524414800 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:22,583 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,583 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,584 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:22,595 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:22,595 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:22,595 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,598 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:22,605 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,605 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:22,605 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:22,608 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:22,610 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:10:22,612 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,612 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,613 [282] [DEBUG] [app] Ending request: urn:request:9f11511a-73ba-4329-a818-d2d524414800 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:9f11511a-73ba-4329-a818-d2d524414800', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:22,614 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:22,614 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:22 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:22 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1557 0.033)
gunicorn-web stdout | 2024-04-22 04:10:23,001 [281] [DEBUG] [app] Starting request: urn:request:9a10b0c0-5a0f-49c0-b52f-e3d94bade887 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:23,001 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,001 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,002 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,004 [278] [DEBUG] [app] Starting request: urn:request:b01d50ef-436b-4c0d-bc11-97e3788a0d22 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:23,004 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,005 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,005 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,016 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,021 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,022 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:23,023 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,023 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,025 [281] [DEBUG] [app] Ending request: urn:request:9a10b0c0-5a0f-49c0-b52f-e3d94bade887 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:9a10b0c0-5a0f-49c0-b52f-e3d94bade887', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,025 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:23,025 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1558 0.025)
gunicorn-web stdout | 2024-04-22 04:10:23,026 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:23,029 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:10:23,031 [278] [DEBUG] [app] Ending request: urn:request:b01d50ef-436b-4c0d-bc11-97e3788a0d22 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:b01d50ef-436b-4c0d-bc11-97e3788a0d22', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,032 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1558 0.029)
gunicorn-web stdout | 2024-04-22 04:10:23,032 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:10:23,733 [282] [DEBUG] [app] Starting request: urn:request:f9d23801-e05f-48b7-a4f2-33f9bb549d50 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:23,733 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,733 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,734 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,745 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,751 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,752 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,756 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:23,758 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
notificationworker stdout | 2024-04-22 04:10:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:33.759375+00:00 (in 9.999538 seconds)
notificationworker stdout | 2024-04-22 04:10:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:33 UTC)" (scheduled at 2024-04-22 04:10:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
gunicorn-web stdout | 2024-04-22 04:10:23,760 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
notificationworker stdout | 2024-04-22 04:10:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 23, 760304), True, datetime.datetime(2024, 4, 22, 4, 10, 23, 760304), 0, 'notification/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,761 [281] [DEBUG] [app] Starting request: urn:request:5a6f6825-40fe-4482-8a94-1f4cf936ab23 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:10:23,761 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,761 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,762 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,763 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,765 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,767 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,769 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
notificationworker stdout | 2024-04-22 04:10:23,769 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:33 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,771 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,773 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,773 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,775 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,777 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,779 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,779 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,780 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,781 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,783 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,784 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:10:23,785 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,787 [282] [DEBUG] [app] Ending request: urn:request:f9d23801-e05f-48b7-a4f2-33f9bb549d50 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:f9d23801-e05f-48b7-a4f2-33f9bb549d50', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,788 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 2056 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.056 1535 0.056)
gunicorn-web stdout | 2024-04-22 04:10:23,788 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 2056 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:10:23,788 [281] [DEBUG] [app] Ending request: urn:request:5a6f6825-40fe-4482-8a94-1f4cf936ab23 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:5a6f6825-40fe-4482-8a94-1f4cf936ab23', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,789 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:23,789 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:24.361582+00:00 (in 59.999467 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:24 UTC)" (scheduled at 2024-04-22 04:10:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:10:25,433 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:10:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:35.871852+00:00 (in 8.998222 seconds)
securityworker stdout | 2024-04-22 04:10:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:56 UTC)" (scheduled at 2024-04-22 04:10:26.873109+00:00)
securityworker stdout | 2024-04-22 04:10:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:10:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:10:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 5, 26, 881199), 1, 2])
securityworker stdout | 2024-04-22 04:10:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 5, 26, 881199), 1, 2])
securityworker stdout | 2024-04-22 04:10:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:10:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:56 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:27,176 [282] [DEBUG] [app] Starting request: urn:request:caa425f1-c700-4f13-9be1-10ca715a221c (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:27,176 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,176 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,177 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
repositoryactioncounter stdout | 2024-04-22 04:10:27,187 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:10:27,189 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:27,194 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:27,195 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:27,195 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:27,198 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:27,200 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:10:27,202 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,202 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,203 [282] [DEBUG] [app] Ending request: urn:request:caa425f1-c700-4f13-9be1-10ca715a221c (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:caa425f1-c700-4f13-9be1-10ca715a221c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:27,203 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:27,204 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:27 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:27 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1546 0.028)
quotatotalworker stdout | 2024-04-22 04:10:28,412 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:10:28,532 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:10:30,188 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:10:30,191 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:10:30,194 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:10:30,208 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:10:30,212 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:10:30,458 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:10:30,565 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:10:30,653 [281] [DEBUG] [app] Starting request: urn:request:4a7a611a-bda4-45ca-9ce3-6f07d719e009 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:30,653 [282] [DEBUG] [app] Starting request: urn:request:0d12b902-e450-4930-bf90-e4729eecd3b1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [290] [DEBUG] [app] Starting request: urn:request:ebb13670-917d-4375-b4d2-bf01e2ace7b5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [284] [DEBUG] [app] Starting request: urn:request:f23ccd64-164b-440f-9660-0343c6c7b403 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [290] [DEBUG] [app] Ending request: urn:request:ebb13670-917d-4375-b4d2-bf01e2ace7b5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ebb13670-917d-4375-b4d2-bf01e2ace7b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [284] [DEBUG] [app] Ending request: urn:request:f23ccd64-164b-440f-9660-0343c6c7b403 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f23ccd64-164b-440f-9660-0343c6c7b403', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:10:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:10:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:30,659 [281] [DEBUG] [app] Starting request: urn:request:042d2d78-84d2-4c2e-86d6-d9fe41b99cf0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:30,659 [279] [DEBUG] [app] Starting request: urn:request:ae233432-45a0-40b3-bd80-de4366d69ce2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:30,660 [281] [DEBUG] [app] Ending request: urn:request:042d2d78-84d2-4c2e-86d6-d9fe41b99cf0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:042d2d78-84d2-4c2e-86d6-d9fe41b99cf0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:30,660 [279] [DEBUG] [app] Ending request: urn:request:ae233432-45a0-40b3-bd80-de4366d69ce2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ae233432-45a0-40b3-bd80-de4366d69ce2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:30,674 [282] [DEBUG] [app] Ending request: urn:request:0d12b902-e450-4930-bf90-e4729eecd3b1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0d12b902-e450-4930-bf90-e4729eecd3b1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:30,674 [281] [DEBUG] [app] Ending request: urn:request:4a7a611a-bda4-45ca-9ce3-6f07d719e009 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4a7a611a-bda4-45ca-9ce3-6f07d719e009', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:10:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:10:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:46.054492+00:00 (in 14.999467 seconds)
quotatotalworker stdout | 2024-04-22 04:10:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:46 UTC)" (scheduled at 2024-04-22 04:10:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:10:31,405 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:10:32,921 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:10:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:43.759375+00:00 (in 9.999519 seconds)
notificationworker stdout | 2024-04-22 04:10:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:43 UTC)" (scheduled at 2024-04-22 04:10:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 33, 760314), True, datetime.datetime(2024, 4, 22, 4, 10, 33, 760314), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:34,337 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:10:34,617 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:10:34,771 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:10:34,774 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:10:34,776 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:10:34,809 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:10:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:56.873109+00:00 (in 21.000706 seconds)
securityworker stdout | 2024-04-22 04:10:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:05 UTC)" (scheduled at 2024-04-22 04:10:35.871852+00:00)
securityworker stdout | 2024-04-22 04:10:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:10:35,905 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:10:37,114 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:10:37,120 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:10:37,277 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:10:38,237 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:41.564959+00:00 (in 1.997462 seconds)
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:39 UTC)" (scheduled at 2024-04-22 04:10:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:10:39,581 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:10:39,615 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:10:39,972 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:10:40,020 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:10:41,091 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:10:41,096 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:10:41,099 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:10:41,102 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:10:41,105 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:10:41,107 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:10:41,119 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:10:41,122 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:10:41,125 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:10:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:10:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:11.264267+00:00 (in 29.999504 seconds)
autopruneworker stdout | 2024-04-22 04:10:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:11 UTC)" (scheduled at 2024-04-22 04:10:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:10:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758981271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:10:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:10:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:10:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:11 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:10:41,342 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:39.566970+00:00 (in 58.001460 seconds)
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:41 UTC)" (scheduled at 2024-04-22 04:10:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:10:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 41, 565819), True, datetime.datetime(2024, 4, 22, 4, 10, 41, 565819), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:10:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:10:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:10:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:22.058978+00:00 (in 39.001285 seconds)
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:43 UTC)" (scheduled at 2024-04-22 04:10:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:10:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 43, 58014), True, datetime.datetime(2024, 4, 22, 4, 10, 43, 58014), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:10:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:10:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:10:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:53.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 04:10:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:53 UTC)" (scheduled at 2024-04-22 04:10:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 43, 760260), True, datetime.datetime(2024, 4, 22, 4, 10, 43, 760260), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:10:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:10:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:14.952062+00:00 (in 29.999516 seconds)
gcworker stdout | 2024-04-22 04:10:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:14 UTC)" (scheduled at 2024-04-22 04:10:44.952062+00:00)
gcworker stdout | 2024-04-22 04:10:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549444952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:10:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:10:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:10:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:45,653 [282] [DEBUG] [app] Starting request: urn:request:2b0cb473-26b5-4bb6-a786-d047cc328506 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:45,653 [278] [DEBUG] [app] Starting request: urn:request:db643bff-bd19-4dbb-b4ff-8481b24895ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [285] [DEBUG] [app] Starting request: urn:request:32a66c33-8256-4db8-998a-2bd49c3effe7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [284] [DEBUG] [app] Starting request: urn:request:57247a81-b28d-49ee-b3e8-fdab845b3f4c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [285] [DEBUG] [app] Ending request: urn:request:32a66c33-8256-4db8-998a-2bd49c3effe7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:32a66c33-8256-4db8-998a-2bd49c3effe7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [284] [DEBUG] [app] Ending request: urn:request:57247a81-b28d-49ee-b3e8-fdab845b3f4c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:57247a81-b28d-49ee-b3e8-fdab845b3f4c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:45,658 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:10:45,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:10:45,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:45,660 [278] [DEBUG] [app] Starting request: urn:request:7a246b30-dda0-4158-b3af-9c45234a9810 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:45,660 [278] [DEBUG] [app] Ending request: urn:request:7a246b30-dda0-4158-b3af-9c45234a9810 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7a246b30-dda0-4158-b3af-9c45234a9810', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:45,660 [279] [DEBUG] [app] Starting request: urn:request:f91736ff-7a3f-47b7-b801-70a581fdd574 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:45,661 [279] [DEBUG] [app] Ending request: urn:request:f91736ff-7a3f-47b7-b801-70a581fdd574 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f91736ff-7a3f-47b7-b801-70a581fdd574', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:45,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:45,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:45,675 [278] [DEBUG] [app] Ending request: urn:request:db643bff-bd19-4dbb-b4ff-8481b24895ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:db643bff-bd19-4dbb-b4ff-8481b24895ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:10:45,675 [282] [DEBUG] [app] Ending request: urn:request:2b0cb473-26b5-4bb6-a786-d047cc328506 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2b0cb473-26b5-4bb6-a786-d047cc328506', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:10:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:45,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:10:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:01.054492+00:00 (in 14.999451 seconds)
quotatotalworker stdout | 2024-04-22 04:10:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:01 UTC)" (scheduled at 2024-04-22 04:10:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:46,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:10:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:17.052354+00:00 (in 29.999486 seconds)
buildlogsarchiver stdout | 2024-04-22 04:10:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:17 UTC)" (scheduled at 2024-04-22 04:10:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:10:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 10, 47, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:10:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:10:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:10:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:10:50,419 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:10:51,821 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [app] Starting request: urn:request:61c1a012-4ad2-4d3c-b417-8e64cc3a62af (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,738 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,741 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:53,747 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,748 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,752 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,755 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,757 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['slack', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,759 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 1, 6, 5, 'vul slack', '{"url": "https://hooks.slack.com/services/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"}', '{"level": "2"}', 0])
notificationworker stdout | 2024-04-22 04:10:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:03.759375+00:00 (in 9.999553 seconds)
notificationworker stdout | 2024-04-22 04:10:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:03 UTC)" (scheduled at 2024-04-22 04:10:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:53,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 53, 760215), True, datetime.datetime(2024, 4, 22, 4, 10, 53, 760215), 0, 'notification/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,764 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,767 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,769 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 10, 53, 766854), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event": "vulnerability_found", "method": "slack"}'])
notificationworker stdout | 2024-04-22 04:10:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:53,773 [281] [DEBUG] [app] Ending request: urn:request:61c1a012-4ad2-4d3c-b417-8e64cc3a62af (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:61c1a012-4ad2-4d3c-b417-8e64cc3a62af', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'slack', 'config': {'url': 'https://hooks.slack.com/services/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'}, 'eventConfig': {'level': '2'}, 'title': 'vul slack'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:53,774 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:53,774 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:53 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 283 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:53 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 283 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.048 1927 0.047)
gunicorn-web stdout | 2024-04-22 04:10:54,111 [278] [DEBUG] [app] Starting request: urn:request:93a29cb4-98c8-40de-9408-94668ff7af4b (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:10:54,111 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,111 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,112 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,122 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,122 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,124 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:54,130 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,131 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,135 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,138 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,140 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,142 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713759054142, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,145 [278] [DEBUG] [app] Ending request: urn:request:93a29cb4-98c8-40de-9408-94668ff7af4b (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:93a29cb4-98c8-40de-9408-94668ff7af4b', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:54,146 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:54,146 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1582 0.036)
gunicorn-web stdout | 2024-04-22 04:10:54,847 [278] [DEBUG] [app] Starting request: urn:request:590e75c9-3697-4907-acba-88df638d60c2 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:54,847 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,847 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,848 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,858 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,859 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:54,866 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,866 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:54,867 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,869 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,871 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:10:54,873 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,873 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,874 [278] [DEBUG] [app] Ending request: urn:request:590e75c9-3697-4907-acba-88df638d60c2 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:590e75c9-3697-4907-acba-88df638d60c2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:54,875 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:54,875 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1557 0.030)
gunicorn-web stdout | 2024-04-22 04:10:55,264 [278] [DEBUG] [app] Starting request: urn:request:700f5fe9-979b-4037-bba7-0cf516fd7967 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:55,264 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,264 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,265 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,273 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,276 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:55,282 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,283 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,285 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:55,288 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:10:55,291 [278] [DEBUG] [app] Ending request: urn:request:700f5fe9-979b-4037-bba7-0cf516fd7967 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:700f5fe9-979b-4037-bba7-0cf516fd7967', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:55,291 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:55 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1539 0.028)
gunicorn-web stdout | 2024-04-22 04:10:55,291 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:55 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
builder stdout | 2024-04-22 04:10:55,469 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:10:55,987 [278] [DEBUG] [app] Starting request: urn:request:018494c0-f918-476c-ac82-f8569ff9d9dc (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:55,987 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,987 [279] [DEBUG] [app] Starting request: urn:request:a9039ca0-b432-4f39-839d-3b3d5f1b53fc (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:10:55,987 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,988 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,988 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,988 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,988 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:55,997 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:55,997 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,000 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:56,000 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:56,006 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,006 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,007 [279] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:56,007 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,009 [279] [DEBUG] [app] Ending request: urn:request:a9039ca0-b432-4f39-839d-3b3d5f1b53fc (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:a9039ca0-b432-4f39-839d-3b3d5f1b53fc', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:56,010 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:56,010 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:10:56,011 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:56,014 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,016 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,018 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,020 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,021 [282] [DEBUG] [app] Starting request: urn:request:bdaed06f-8176-4863-9414-ece9fcc16160 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:56,021 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,021 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,022 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,022 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,025 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,027 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,029 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,030 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:56,030 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:56,030 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,031 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,033 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,033 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:56,035 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,037 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,039 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,039 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,040 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,041 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,043 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,044 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:10:56,045 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,048 [278] [DEBUG] [app] Ending request: urn:request:018494c0-f918-476c-ac82-f8569ff9d9dc (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:018494c0-f918-476c-ac82-f8569ff9d9dc', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:56,048 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:56,048 [282] [DEBUG] [app] Ending request: urn:request:bdaed06f-8176-4863-9414-ece9fcc16160 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:bdaed06f-8176-4863-9414-ece9fcc16160', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 2340 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.062 1535 0.062)
gunicorn-web stdout | 2024-04-22 04:10:56,048 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 2340 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:10:56,049 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:56,049 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
securityworker stdout | 2024-04-22 04:10:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:05.871852+00:00 (in 8.998244 seconds)
securityworker stdout | 2024-04-22 04:10:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:26 UTC)" (scheduled at 2024-04-22 04:10:56.873109+00:00)
securityworker stdout | 2024-04-22 04:10:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:10:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:10:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 5, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:10:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 5, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:10:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:10:57,224 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:10:58,428 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:10:58,546 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:11:00,199 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:11:00,201 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:11:00,205 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:11:00,218 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:11:00,222 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:11:00,495 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:11:00,592 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:11:00,652 [279] [DEBUG] [app] Starting request: urn:request:6a664ba0-5017-4b5a-a40f-835246c43ccb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:00,652 [282] [DEBUG] [app] Starting request: urn:request:be90d601-636e-491e-b407-746e35807348 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:00,655 [284] [DEBUG] [app] Starting request: urn:request:eef5a57a-fef6-46da-b7bd-392bc304ddc2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:00,655 [291] [DEBUG] [app] Starting request: urn:request:3671f286-3c1d-4c61-aac9-013bedbd962a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [284] [DEBUG] [app] Ending request: urn:request:eef5a57a-fef6-46da-b7bd-392bc304ddc2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eef5a57a-fef6-46da-b7bd-392bc304ddc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [291] [DEBUG] [app] Ending request: urn:request:3671f286-3c1d-4c61-aac9-013bedbd962a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3671f286-3c1d-4c61-aac9-013bedbd962a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:00,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:00,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:11:00,657 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [DEBUG] [app] Starting request: urn:request:92fc9641-08a0-4d68-b86a-5364a50f9ce3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [DEBUG] [app] Ending request: urn:request:92fc9641-08a0-4d68-b86a-5364a50f9ce3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:92fc9641-08a0-4d68-b86a-5364a50f9ce3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:00,659 [278] [DEBUG] [app] Starting request: urn:request:7481d63f-3aa8-427e-b0f9-6942ea02f7b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:00,659 [278] [DEBUG] [app] Ending request: urn:request:7481d63f-3aa8-427e-b0f9-6942ea02f7b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7481d63f-3aa8-427e-b0f9-6942ea02f7b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:11:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:00,673 [279] [DEBUG] [app] Ending request: urn:request:6a664ba0-5017-4b5a-a40f-835246c43ccb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6a664ba0-5017-4b5a-a40f-835246c43ccb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:00,673 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:11:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:11:00,674 [282] [DEBUG] [app] Ending request: urn:request:be90d601-636e-491e-b407-746e35807348 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be90d601-636e-491e-b407-746e35807348', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:11:00,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:11:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:16.054492+00:00 (in 14.999469 seconds)
quotatotalworker stdout | 2024-04-22 04:11:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:16 UTC)" (scheduled at 2024-04-22 04:11:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:11:01,441 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:16.552337+00:00 (in 13.995506 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:02 UTC)" (scheduled at 2024-04-22 04:11:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:02,957 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:11:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:13.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:11:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:13 UTC)" (scheduled at 2024-04-22 04:11:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 3, 760195), True, datetime.datetime(2024, 4, 22, 4, 11, 3, 760195), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:04,373 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:11:04,626 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:11:04,779 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:11:04,781 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:11:04,784 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:11:04,846 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:11:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:26.873109+00:00 (in 21.000723 seconds)
securityworker stdout | 2024-04-22 04:11:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:35 UTC)" (scheduled at 2024-04-22 04:11:05.871852+00:00)
securityworker stdout | 2024-04-22 04:11:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:11:05,941 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:11:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:11:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:13.555667+00:00 (in 7.002656 seconds)
repositorygcworker stdout | 2024-04-22 04:11:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:06 UTC)" (scheduled at 2024-04-22 04:11:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:11:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:11:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 6, 553424), True, datetime.datetime(2024, 4, 22, 4, 11, 6, 553424), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:11:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:11:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:11:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:11:07,140 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:11:07,155 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:11:07,313 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:11:08,272 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:11:09,618 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:11:09,651 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:11:10,008 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:11:10,055 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:11:11,100 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:11:11,105 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:11:11,110 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:11:11,112 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:11:11,115 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:11:11,118 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:11:11,132 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:11:11,134 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:11:11,137 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:11:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:11:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:41.264267+00:00 (in 29.999443 seconds)
autopruneworker stdout | 2024-04-22 04:11:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:41 UTC)" (scheduled at 2024-04-22 04:11:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:11:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759011272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:11:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:11:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:11:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:11:11,378 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:11:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:51.555445+00:00 (in 37.999257 seconds)
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:13 UTC)" (scheduled at 2024-04-22 04:11:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:19.762424+00:00 (in 6.002528 seconds)
notificationworker stdout | 2024-04-22 04:11:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:23 UTC)" (scheduled at 2024-04-22 04:11:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 13, 760332), True, datetime.datetime(2024, 4, 22, 4, 11, 13, 760332), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:11:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:11:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:44.952062+00:00 (in 29.999552 seconds)
gcworker stdout | 2024-04-22 04:11:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:44 UTC)" (scheduled at 2024-04-22 04:11:14.952062+00:00)
gcworker stdout | 2024-04-22 04:11:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549474952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:11:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:11:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:11:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:11:15,652 [279] [DEBUG] [app] Starting request: urn:request:b279a13d-c26e-4bab-808e-5678ec41dcbb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:15,652 [282] [DEBUG] [app] Starting request: urn:request:f0406173-dd82-46ee-aa96-81af4cabd53e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [284] [DEBUG] [app] Starting request: urn:request:1576cf8a-3df0-4b7c-aa47-eebd7998720f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [292] [DEBUG] [app] Starting request: urn:request:2bafa40d-7ddf-45a3-956b-6b2e805a5f98 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [292] [DEBUG] [app] Ending request: urn:request:2bafa40d-7ddf-45a3-956b-6b2e805a5f98 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2bafa40d-7ddf-45a3-956b-6b2e805a5f98', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [284] [DEBUG] [app] Ending request: urn:request:1576cf8a-3df0-4b7c-aa47-eebd7998720f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1576cf8a-3df0-4b7c-aa47-eebd7998720f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:15,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:15,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:15,659 [279] [DEBUG] [app] Starting request: urn:request:44f6928f-94f4-4b77-992d-48b46bd36224 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:15,659 [279] [DEBUG] [app] Ending request: urn:request:44f6928f-94f4-4b77-992d-48b46bd36224 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:44f6928f-94f4-4b77-992d-48b46bd36224', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:15,659 [278] [DEBUG] [app] Starting request: urn:request:832a2273-bc1c-493b-b7a8-6122aa8ce417 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:15,660 [278] [DEBUG] [app] Ending request: urn:request:832a2273-bc1c-493b-b7a8-6122aa8ce417 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:832a2273-bc1c-493b-b7a8-6122aa8ce417', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:11:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:15,673 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:15,674 [282] [DEBUG] [app] Ending request: urn:request:f0406173-dd82-46ee-aa96-81af4cabd53e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0406173-dd82-46ee-aa96-81af4cabd53e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:11:15,681 [279] [DEBUG] [app] Ending request: urn:request:b279a13d-c26e-4bab-808e-5678ec41dcbb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b279a13d-c26e-4bab-808e-5678ec41dcbb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:15,681 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:15,681 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.030)
quotatotalworker stdout | 2024-04-22 04:11:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:31.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:11:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:31 UTC)" (scheduled at 2024-04-22 04:11:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:02.556208+00:00 (in 46.003288 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:16 UTC)" (scheduled at 2024-04-22 04:11:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 16, 553357), True, datetime.datetime(2024, 4, 22, 4, 11, 16, 553357), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:11:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:47.052354+00:00 (in 29.999449 seconds)
buildlogsarchiver stdout | 2024-04-22 04:11:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:47 UTC)" (scheduled at 2024-04-22 04:11:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:11:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 11, 17, 53299), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:11:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:11:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:11:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:23.759375+00:00 (in 3.996441 seconds)
notificationworker stdout | 2024-04-22 04:11:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:19 UTC)" (scheduled at 2024-04-22 04:11:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:11:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:11:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:11:20,453 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:11:21,858 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:43.057186+00:00 (in 20.997641 seconds)
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:22 UTC)" (scheduled at 2024-04-22 04:11:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:23,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:33.759375+00:00 (in 9.999398 seconds)
notificationworker stdout | 2024-04-22 04:11:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:33 UTC)" (scheduled at 2024-04-22 04:11:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 23, 760368), True, datetime.datetime(2024, 4, 22, 4, 11, 23, 760368), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:24.361582+00:00 (in 59.999452 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:24 UTC)" (scheduled at 2024-04-22 04:11:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:11:25,507 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:11:26,419 [278] [DEBUG] [app] Starting request: urn:request:e8b74243-f87a-4a1c-b2dd-eab0887ed442 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:11:26,420 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,420 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,420 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,432 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:11:26,438 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,439 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:26,444 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:11:26,448 [278] [DEBUG] [app] Ending request: urn:request:e8b74243-f87a-4a1c-b2dd-eab0887ed442 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:e8b74243-f87a-4a1c-b2dd-eab0887ed442', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:11:26,448 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:26,449 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:11:26 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:11:26 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
securityworker stdout | 2024-04-22 04:11:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:35.871852+00:00 (in 8.998252 seconds)
securityworker stdout | 2024-04-22 04:11:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:56 UTC)" (scheduled at 2024-04-22 04:11:26.873109+00:00)
securityworker stdout | 2024-04-22 04:11:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:11:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:11:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 6, 26, 881973), 1, 2])
securityworker stdout | 2024-04-22 04:11:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 6, 26, 881973), 1, 2])
securityworker stdout | 2024-04-22 04:11:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:11:27,260 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:11:28,464 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:11:28,560 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:11:30,208 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:11:30,210 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:11:30,216 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:11:30,231 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:11:30,234 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:11:30,510 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:11:30,629 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:11:30,653 [279] [DEBUG] [app] Starting request: urn:request:61ee63a9-006f-481e-998f-33bc965d5bf7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:30,653 [282] [DEBUG] [app] Starting request: urn:request:87125e19-4be6-405e-bff0-b21e38c1f794 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:30,656 [291] [DEBUG] [app] Starting request: urn:request:f025b808-8316-4d79-8751-77a412e6aa2b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:30,656 [291] [DEBUG] [app] Ending request: urn:request:f025b808-8316-4d79-8751-77a412e6aa2b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f025b808-8316-4d79-8751-77a412e6aa2b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:30,656 [284] [DEBUG] [app] Starting request: urn:request:f64c0474-753e-49d2-944d-27e4ada648c6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:30,657 [284] [DEBUG] [app] Ending request: urn:request:f64c0474-753e-49d2-944d-27e4ada648c6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f64c0474-753e-49d2-944d-27e4ada648c6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:11:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:11:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:30,659 [279] [DEBUG] [app] Starting request: urn:request:e48b81cb-4553-4b52-bc1d-992a6be96e35 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:30,659 [278] [DEBUG] [app] Starting request: urn:request:55a01dcf-cd66-4728-8fd2-a7519bc9237c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:30,660 [279] [DEBUG] [app] Ending request: urn:request:e48b81cb-4553-4b52-bc1d-992a6be96e35 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e48b81cb-4553-4b52-bc1d-992a6be96e35', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:30,660 [278] [DEBUG] [app] Ending request: urn:request:55a01dcf-cd66-4728-8fd2-a7519bc9237c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:55a01dcf-cd66-4728-8fd2-a7519bc9237c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:30,674 [279] [DEBUG] [app] Ending request: urn:request:61ee63a9-006f-481e-998f-33bc965d5bf7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:61ee63a9-006f-481e-998f-33bc965d5bf7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:11:30,684 [282] [DEBUG] [app] Ending request: urn:request:87125e19-4be6-405e-bff0-b21e38c1f794 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:87125e19-4be6-405e-bff0-b21e38c1f794', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:30,684 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:30,684 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.032 118 0.032)
quotatotalworker stdout | 2024-04-22 04:11:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:46.054492+00:00 (in 14.999464 seconds)
quotatotalworker stdout | 2024-04-22 04:11:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:46 UTC)" (scheduled at 2024-04-22 04:11:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:11:31,478 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:11:32,977 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:11:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:33,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:43.759375+00:00 (in 9.999314 seconds)
notificationworker stdout | 2024-04-22 04:11:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:43 UTC)" (scheduled at 2024-04-22 04:11:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 33, 760480), True, datetime.datetime(2024, 4, 22, 4, 11, 33, 760480), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:34,405 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:11:34,662 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:11:34,787 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:11:34,790 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:11:34,792 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:11:34,883 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:11:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:56.873109+00:00 (in 21.000734 seconds)
securityworker stdout | 2024-04-22 04:11:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:05 UTC)" (scheduled at 2024-04-22 04:11:35.871852+00:00)
securityworker stdout | 2024-04-22 04:11:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:11:35,961 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:11:37,152 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:11:37,192 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:11:37,321 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:11:38,302 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:41.564959+00:00 (in 1.997411 seconds)
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:39 UTC)" (scheduled at 2024-04-22 04:11:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:11:39,635 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:11:39,687 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:11:40,044 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:11:40,069 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:11:41,110 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:11:41,113 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:11:41,119 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:11:41,123 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:11:41,126 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:11:41,129 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:11:41,140 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:11:41,144 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:11:41,147 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:11:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:11:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:11.264267+00:00 (in 29.999433 seconds)
autopruneworker stdout | 2024-04-22 04:11:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:11 UTC)" (scheduled at 2024-04-22 04:11:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:11:41,275 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759041275, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:11:41,279 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:11:41,279 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:11:41,279 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:11 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:11:41,406 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:53.566665+00:00 (in 12.001203 seconds)
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:41 UTC)" (scheduled at 2024-04-22 04:11:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:11:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 41, 565754), True, datetime.datetime(2024, 4, 22, 4, 11, 41, 565754), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:11:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:11:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:11:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:41 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,969 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,969 [61] [INFO] [apscheduler.executors.default] Running job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2024-04-22 04:11:42 UTC)" (scheduled at 2024-04-22 04:11:42.968897+00:00)
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,969 [61] [DEBUG] [util.locking] Acquiring global lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,970 [61] [DEBUG] [redis_lock.acquire] Getting 'lock:BLOB_CLEANUP' ...
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,970 [61] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 05:11:42.968897+00:00 (in 3599.998620 seconds)
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,973 [61] [INFO] [redis_lock.acquire] Got lock for 'lock:BLOB_CLEANUP'.
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,973 [61] [DEBUG] [util.locking] Acquired lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,973 [61] [DEBUG] [__main__] Performing blob upload cleanup
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,974 [61] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."created" <= %s) LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 20, 4, 11, 42, 973267), 1, 0])
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [__main__] No additional stale blob uploads found
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [data.database] Disconnecting from database.
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [__main__] Cleaning partial uploads not applicable to storage location "default"
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [util.locking] Releasing lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [redis_lock.release] Releasing 'lock:BLOB_CLEANUP'.
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,984 [61] [DEBUG] [util.locking] Released lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,984 [61] [INFO] [apscheduler.executors.default] Job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2024-04-22 05:11:42 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:22.058978+00:00 (in 39.001335 seconds)
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:43 UTC)" (scheduled at 2024-04-22 04:11:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:11:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 43, 57927), True, datetime.datetime(2024, 4, 22, 4, 11, 43, 57927), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:11:43,067 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:11:43,067 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:11:43,067 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:53.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 04:11:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:53 UTC)" (scheduled at 2024-04-22 04:11:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 43, 760236), True, datetime.datetime(2024, 4, 22, 4, 11, 43, 760236), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:11:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:11:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:14.952062+00:00 (in 29.999466 seconds)
gcworker stdout | 2024-04-22 04:11:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:14 UTC)" (scheduled at 2024-04-22 04:11:44.952062+00:00)
gcworker stdout | 2024-04-22 04:11:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549504952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:11:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:11:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:11:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:11:45,653 [282] [DEBUG] [app] Starting request: urn:request:3a598b06-fd55-4b1d-8f10-95fc3d099fb6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:45,653 [279] [DEBUG] [app] Starting request: urn:request:6eaefa9e-b046-4919-ac54-4c719d3f3313 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [290] [DEBUG] [app] Starting request: urn:request:4245da74-2b35-4f69-8405-8058cf94efab (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [292] [DEBUG] [app] Starting request: urn:request:1980cace-add9-436f-aac1-de755c94a044 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [290] [DEBUG] [app] Ending request: urn:request:4245da74-2b35-4f69-8405-8058cf94efab (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4245da74-2b35-4f69-8405-8058cf94efab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [292] [DEBUG] [app] Ending request: urn:request:1980cace-add9-436f-aac1-de755c94a044 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1980cace-add9-436f-aac1-de755c94a044', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:11:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:11:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:45,659 [279] [DEBUG] [app] Starting request: urn:request:30bfe784-c0c5-4ca7-98f6-5698c9fae513 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:45,659 [279] [DEBUG] [app] Ending request: urn:request:30bfe784-c0c5-4ca7-98f6-5698c9fae513 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:30bfe784-c0c5-4ca7-98f6-5698c9fae513', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:45,659 [281] [DEBUG] [app] Starting request: urn:request:4ea2a64a-fa4b-43e5-9c22-6bd23568c0c7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:45,660 [281] [DEBUG] [app] Ending request: urn:request:4ea2a64a-fa4b-43e5-9c22-6bd23568c0c7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4ea2a64a-fa4b-43e5-9c22-6bd23568c0c7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:45,674 [279] [DEBUG] [app] Ending request: urn:request:6eaefa9e-b046-4919-ac54-4c719d3f3313 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6eaefa9e-b046-4919-ac54-4c719d3f3313', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:11:45,674 [282] [DEBUG] [app] Ending request: urn:request:3a598b06-fd55-4b1d-8f10-95fc3d099fb6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3a598b06-fd55-4b1d-8f10-95fc3d099fb6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:11:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:11:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:11:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:01.054492+00:00 (in 14.999493 seconds)
quotatotalworker stdout | 2024-04-22 04:11:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:01 UTC)" (scheduled at 2024-04-22 04:11:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:11:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:17.052354+00:00 (in 29.999467 seconds)
buildlogsarchiver stdout | 2024-04-22 04:11:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:17 UTC)" (scheduled at 2024-04-22 04:11:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:11:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 11, 47, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:11:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:11:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:11:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:11:50,489 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:11:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:11:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:06.552482+00:00 (in 14.996490 seconds)
repositorygcworker stdout | 2024-04-22 04:11:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:51 UTC)" (scheduled at 2024-04-22 04:11:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:11:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:11:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), True, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:11:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), True, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:11:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:11:51,571 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:11:51,868 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:11:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:11:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:39.566970+00:00 (in 45.999733 seconds)
exportactionlogsworker stdout | 2024-04-22 04:11:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:53 UTC)" (scheduled at 2024-04-22 04:11:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:11:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:11:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), True, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:11:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), True, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:11:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:11:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:03.759375+00:00 (in 9.999432 seconds)
notificationworker stdout | 2024-04-22 04:11:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:03 UTC)" (scheduled at 2024-04-22 04:11:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 53, 760409), True, datetime.datetime(2024, 4, 22, 4, 11, 53, 760409), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:53,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:53,777 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:53,777 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:11:55,521 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:11:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:05.871852+00:00 (in 8.998285 seconds)
securityworker stdout | 2024-04-22 04:11:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:26 UTC)" (scheduled at 2024-04-22 04:11:56.873109+00:00)
securityworker stdout | 2024-04-22 04:11:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:11:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:11:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:11:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 6, 56, 880587), 1, 2])
securityworker stdout | 2024-04-22 04:11:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 6, 56, 880587), 1, 2])
securityworker stdout | 2024-04-22 04:11:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:11:57,286 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:11:57,518 [282] [DEBUG] [app] Starting request: urn:request:d8f9cc26-b036-4b73-b89e-b67d30dda2ab (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:11:57,518 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,518 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,519 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,531 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:11:57,537 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,538 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:57,542 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:11:57,546 [282] [DEBUG] [app] Ending request: urn:request:d8f9cc26-b036-4b73-b89e-b67d30dda2ab (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:d8f9cc26-b036-4b73-b89e-b67d30dda2ab', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:11:57,547 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:11:57 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:11:57,547 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:11:57 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-registry stdout | 2024-04-22 04:11:57,592 [284] [DEBUG] [app] Starting request: urn:request:007516e6-37f5-4b21-bf7f-ebc6f5c9e19c (/v2/) {'X-Forwarded-For': '123.123.45.4, 10.128.2.8'}
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {}
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [DEBUG] [auth.registry_jwt_auth] No auth header.
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [DEBUG] [app] Ending request: urn:request:007516e6-37f5-4b21-bf7f-ebc6f5c9e19c (/v2/) {'endpoint': 'v2.v2_support_enabled', 'request_id': 'urn:request:007516e6-37f5-4b21-bf7f-ebc6f5c9e19c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/', 'path': '/v2/', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:11:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "skopeo/1.14.2" (0.002 522 0.002)
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:11:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "skopeo/1.14.2"
gunicorn-registry stdout | 2024-04-22 04:11:58,394 [284] [DEBUG] [app] Starting request: urn:request:2b593752-a54b-4edc-a62c-f69807b553b1 (/v2/auth) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:11:58,394 [284] [DEBUG] [auth.basic] Attempt to process basic auth header
gunicorn-registry stdout | 2024-04-22 04:11:58,396 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['whuquay', 'whuquay', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,396 [284] [DEBUG] [peewee.pool] No connection available in pool.
gunicorn-registry stdout | 2024-04-22 04:11:58,405 [284] [DEBUG] [peewee.pool] Created new connection 140532887700160.
quotatotalworker stdout | 2024-04-22 04:11:58,494 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:11:58,576 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-registry stdout | 2024-04-22 04:11:58,644 [284] [DEBUG] [auth.credentials] Successfully validated credentials for user whuquay
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.basic: 'basic'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [endpoints.v2.v2auth] Request audience: quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [endpoints.v2.v2auth] Scope request: ['repository:build_test/pushno:pull,push']
gunicorn-registry stdout | 2024-04-22 04:11:58,646 [284] [DEBUG] [endpoints.v2.v2auth] Match: ('build_test/pushno', 'build_test/pushno', 'pull,push')
gunicorn-registry stdout | 2024-04-22 04:11:58,647 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,650 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,654 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,656 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,658 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:11:58,661 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,662 [284] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-registry stdout | 2024-04-22 04:11:58,663 [284] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,663 [284] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,663 [284] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,665 [284] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-registry stdout | 2024-04-22 04:11:58,671 [284] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,671 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,674 [284] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [DEBUG] [app] Ending request: urn:request:2b593752-a54b-4edc-a62c-f69807b553b1 (/v2/auth) {'endpoint': 'v2.generate_registry_jwt', 'request_id': 'urn:request:2b593752-a54b-4edc-a62c-f69807b553b1', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/auth?account=whuquay&scope=repository:build_test/pushno:pull,push&service=quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com', 'path': '/v2/auth', 'parameters': {'account': 'whuquay', 'scope': 'repository:build_test/pushno:pull,push', 'service': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com'}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
nginx stdout | 10.131.0.9 (-) - whuquay [22/Apr/2024:04:11:58 +0000] "GET /v2/auth?account=whuquay&scope=repository%3Abuild_test%2Fpushno%3Apull%2Cpush&service=quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com HTTP/1.1" 200 1106 "-" "skopeo/1.14.2" (0.290 687 0.290)
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [INFO] [gunicorn.access] 10.131.0.9 - whuquay [22/Apr/2024:04:11:58 +0000] "GET /v2/auth?account=whuquay&scope=repository%3Abuild_test%2Fpushno%3Apull%2Cpush&service=quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com HTTP/1.1" 200 1106 "-" "skopeo/1.14.2"
gunicorn-registry stdout | 2024-04-22 04:11:58,686 [284] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_start', 'namespace': 'build_test', 'repository': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:11:58,943 [284] [DEBUG] [app] Starting request: urn:request:6320a742-17a6-4e77-8f65-3c94584657ff (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:11:58,944 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:11:58,944 [284] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:11:58,944 [284] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:11:58,945 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 4, 11, 58, 944465), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 4, 11, 58, 944485), 'quay', None, datetime.datetime(2024, 4, 21, 4, 11, 58, 944504), datetime.datetime(2024, 4, 15, 4, 11, 58, 944514), None])
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:11:58,951 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,953 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,956 [284] [DEBUG] [endpoints.decorators] Skipping pull through proxy cache: <Model: ProxyCacheConfig> instance matching query does not exist:
gunicorn-registry stdout | SQL: SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s
gunicorn-registry stdout | Params: ['build_test', True, 1, 0]
gunicorn-registry stdout | 2024-04-22 04:11:58,956 [284] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2
gunicorn-registry stdout | 2024-04-22 04:11:58,956 [284] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2; calling loader
gunicorn-registry stdout | 2024-04-22 04:11:58,957 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,959 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,961 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,964 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,967 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,969 [284] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:11:58,969 [284] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n'
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [app] Ending request: urn:request:6320a742-17a6-4e77-8f65-3c94584657ff (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'endpoint': 'v2.check_blob_exists', 'request_id': 'urn:request:6320a742-17a6-4e77-8f65-3c94584657ff', 'remote_addr': '10.131.0.9', 'http_method': 'HEAD', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'path': '/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:11:58 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:11:58 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2" (0.029 1712 0.029)
gunicorn-web stdout | 2024-04-22 04:12:00,217 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:12:00,220 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:12:00,226 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:12:00,242 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:12:00,246 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [app] Starting request: urn:request:cf72d8cf-cef9-4a62-b237-cf77fc9e41de (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:12:00,382 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,385 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,388 [284] [DEBUG] [endpoints.decorators] Skipping pull through proxy cache: <Model: ProxyCacheConfig> instance matching query does not exist:
gunicorn-registry stdout | SQL: SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s
gunicorn-registry stdout | Params: ['build_test', True, 1, 0]
gunicorn-registry stdout | 2024-04-22 04:12:00,388 [284] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2
gunicorn-registry stdout | 2024-04-22 04:12:00,388 [284] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2; calling loader
gunicorn-registry stdout | 2024-04-22 04:12:00,389 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,391 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,393 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,395 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,398 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n'
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [app] Ending request: urn:request:cf72d8cf-cef9-4a62-b237-cf77fc9e41de (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'endpoint': 'v2.check_blob_exists', 'request_id': 'urn:request:cf72d8cf-cef9-4a62-b237-cf77fc9e41de', 'remote_addr': '10.131.0.9', 'http_method': 'HEAD', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'path': '/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:00,401 [284] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:00 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:00 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2" (0.022 1712 0.022)
teamsyncworker stdout | 2024-04-22 04:12:00,525 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:12:00,651 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:12:00,653 [281] [DEBUG] [app] Starting request: urn:request:d700c542-e797-4fef-90b2-4baf760aa40b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:00,653 [279] [DEBUG] [app] Starting request: urn:request:9380c9ec-ae12-43c5-9849-25591cd52fe4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [288] [DEBUG] [app] Starting request: urn:request:22ae4383-8a02-4769-9d02-825065e7e962 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [291] [DEBUG] [app] Starting request: urn:request:ed06f2d9-d017-4007-a5c0-96ceb4327b68 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [291] [DEBUG] [app] Ending request: urn:request:ed06f2d9-d017-4007-a5c0-96ceb4327b68 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed06f2d9-d017-4007-a5c0-96ceb4327b68', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [288] [DEBUG] [app] Ending request: urn:request:22ae4383-8a02-4769-9d02-825065e7e962 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:22ae4383-8a02-4769-9d02-825065e7e962', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:12:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [app] Starting request: urn:request:504b2c4e-206e-4a21-a4ef-77a907481499 (/v2/build_test/pushno/blobs/uploads/) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:00,660 [284] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ModifyRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:12:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:00,660 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:00,661 [282] [DEBUG] [app] Starting request: urn:request:1988d553-8c5d-4cb2-98ad-dcc4ce67a13a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:00,661 [278] [DEBUG] [app] Starting request: urn:request:321dd07e-2daf-4161-8fbf-23ecf890121c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:00,661 [282] [DEBUG] [app] Ending request: urn:request:1988d553-8c5d-4cb2-98ad-dcc4ce67a13a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1988d553-8c5d-4cb2-98ad-dcc4ce67a13a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:00,661 [278] [DEBUG] [app] Ending request: urn:request:321dd07e-2daf-4161-8fbf-23ecf890121c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:321dd07e-2daf-4161-8fbf-23ecf890121c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:00,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:12:00,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:00,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-registry stdout | 2024-04-22 04:12:00,663 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,665 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,668 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:00,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-registry stdout | 2024-04-22 04:12:00,670 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,673 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,675 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:12:00,676 [281] [DEBUG] [app] Ending request: urn:request:d700c542-e797-4fef-90b2-4baf760aa40b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d700c542-e797-4fef-90b2-4baf760aa40b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:00,676 [279] [DEBUG] [app] Ending request: urn:request:9380c9ec-ae12-43c5-9849-25591cd52fe4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9380c9ec-ae12-43c5-9849-25591cd52fe4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 04:12:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-registry stdout | 2024-04-22 04:12:00,677 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,679 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:12:00,682 [284] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2024, 4, 22, 4, 12, 0, 681574)])
gunicorn-registry stdout | 2024-04-22 04:12:00,695 [284] [DEBUG] [app] Ending request: urn:request:504b2c4e-206e-4a21-a4ef-77a907481499 (/v2/build_test/pushno/blobs/uploads/) {'endpoint': 'v2.start_blob_upload', 'request_id': 'urn:request:504b2c4e-206e-4a21-a4ef-77a907481499', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/uploads/', 'path': '/v2/build_test/pushno/blobs/uploads/', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:00,695 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:00,695 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:00,696 [284] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:00 +0000] "POST /v2/build_test/pushno/blobs/uploads/ HTTP/1.1" 202 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:00 +0000] "POST /v2/build_test/pushno/blobs/uploads/ HTTP/1.1" 202 0 "-" "skopeo/1.14.2" (0.039 1691 0.039)
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [app] Starting request: urn:request:294acc99-e581-40aa-914b-4ce04b0ccbd9 (/v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJx